M»~AM2  151  BROWN  UNIV  PROVIDENCE  RI  LEFSCHETZ  CENTER  FOR  DYNAMI— ETC  F/6  12/1 

A  COMPARISON  OF  NUMERICAL  METHODS  FOR  IDENTIFICATION  AND  OPTIMI— ETC«U) 
NOV  79  H  T  BANKS*  J  A  BURNS#  E  M  CLIFF  DAA029-79-C-0161 

UNCLASSIFIED  LCDS-TR-79-7  AFOSR-TR-80-0146  NL 


UNCLASSIFIED 


|  UTV  CLASSIFICATION  OF  THIS  page  (Wien  Dole  Entered) 


.  GOVT  ACCESSION  NO 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


3.  RECIPIENT'S  CATALOG  NUMBER 


LA  J&OMPARISON  OF  JJUMERICAL_iIETHODS  FOR  JDENTIFI- 
xA’flON  AND  OPTIMIZATION  PROBLEMS  JNVOUflNG 

I  .CONTROL  SYSTEMS  WITH  DELAYS  .  r 

~  ■■  iw TV-  ,  ,  ■ 


S.  TYPE  or  REPORT  ft  PERIOD  COVERED 


fo 


H.  T. /Banks  J. A. /Burns  E. 


m7 


Cliff 


^AAGa9-'79-C-2TlGi ,  / 

x/AFdSR  -7  6-3^92  ^  - ' 


9.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Brown  University 

Division  of  Applied  Mathematics 

Providence,  RI  02912 


10.  PROGRAM  ELEMENT,  PROJECT.  TASK 
AREAft-RTOIK  UNIT  NUMBERS 


II.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 


Air  Force  Office  of  Scientific  Research/NM 
Bolling  AFB,  Washington,  D.  C.  20332 


NUMBER  OF  PAGES 
188 


<4.  MONITORING  AGENCY  NAME  ft  ADORESSf//  dllterent  from  Controlling  Ollice) 


16.  DISTRIBUTION  STATEMENT  ( o I  thle  Report) 


Ok 


jj°t 


IS.  SECURITY  CLASS,  (cl  t hi*  roport) 

UNCLASSIFIED 


15a.  DECLASSIFICATION/ DOWNGRADING 
SCHEDULE 


Approved  for  public  release;  distribution  unlimited. 


Oil 

LCDS  -W-  7 

'7-7 

7 

17.  DISTRIBUTION  STYLT«MEn| 

(ot  the  abat/acl  entered  Jin  Block, 2t 

).  it  ditto* 

nnflrom  Report) 

18.  supplementary  notes 

19.  KEY  WORDS  (Continue  on  riven*  tide  if  necettary  and  Identity  by  block  number) 


\ 

10.  A%: 


20.  ABSTRACT  ( Continue  on  rovorto  atdo  II  nacoaoory  and  Identity  by  block  number) 

this  report  w«>  presents^numerical  results  for  two  approximation  techniques 
for  functional  differential  control  systems.  One 'techniques  is  based  on  an 
averaging  scheme,  the  other  on  spline  approximations.  A  number  of  examples 
are  considered  and  the  techniques  are  applieqto  parameter  estimation  problems 
and  optimal  control  problems  where  the  systems  are  given  by  differential 
equations  with  hereditary  terms.  ~  t 

_ \  OL 


dd  wj 


lAx 


EDITION  OF  I  NOV  SI  IS  OBSOLETE 


UNCLASSIFIED 


- . / 


A  Comparison  of  Numerical  Methods 
for 

Identification  and  Optimization  Problems 
Involving  Control  Systems  With  Delays 
(November,  1979) 


H.  T.  Banks* 

Lefschetz  Center  for  Dynamical  Systems 
Division  of  Applied  Mathematics 
Brown  University 
Providence,  RI  02912 


J.  A.  Burns** 

Department  of  Mathematics 

Virginia  Polytechnic  Institute  and  State  University 
Blacksburg,  VA  24061 


E.  M.  Cliff** 

Aerospace  and  Ocean  Engineering  Department 
Virginia  Polytechnic  Institute  and  State  University 
Blacksburg,  VA  24061 


*  This  research  was  supported  in  part  by  the  U.S.  Air  Force  under 
grant  AF-AF0SR-76-3092C,  in  part  by  the  National  Science  Foundation 
under  grant  MCS-79-05774,  and  in  part  by  the  U.S.  Army  under  grant 
DAAG-29- 79-C-0161 . 

**  This  research  was  supported  in  part  by  the  U.S.  Army  under  grant 
DAAG-29-78-G-0125 .  A; 


A . 

f t  ij } * . « i o c . i  c  w- . i  i.  i  ict*r 


i 


w 


A  COMPARISON  OF  NUMERICAL  METHODS  FOR  IDENTIFICATION 


AND  OPTIMIZATION  PROBLEMS  INVOLVING  CONTROL  SYSTEMS  WITH  DELAYS 

H.T.  Banks,  J.A.  Burns  and  E.M.  Cliff 

ABSTRACT 

In  this  report  we  present  numerical  results  for  two  approximation 
techniques  for  functional  differential  control  systems.  One  technique  is 
based  on  an  averaging  scheme,  the  other  on  spline  approximations.  A  number 
of  examples  are  considered  and  the  techniques  are  applied  to  parameter 
estimation  problems  and  optimal  control  problems  where  the  systems  are  given 
by  differential  equations  with  hereditary  terms. 


1.  Introduction. 
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I 
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This  report  is  devoted  to  a  detailed  study,  via  numerical 
experiments,  of  certain  algorithms  for  the  control  and  identification 
of  linear  hereditary  systems.  In  particular,  we  shall  consider  two 
schemes  ("averaging"  and  linear  "spline"  approximations)  which  are 
based  on  the  general  approximation  method  developed  in  £  1] ,  [2], 

* 31 ,  r 5’ .  The  purpose  of  this  report  is  to  present  examples  which 
facilitate  a  comparison  of  the  numerical  performance  of  these  two 
schemes  for  parameter  identification  and  for  optimal  control  pro¬ 
blems.  We  shall  not  dwell  upon  theoretical  convergence  results. 

The  interested  reader  is  referred  to  [ 5 ]  for  complete  statements 
of  convergence  results,  error  estimates  and  detailed  proofs - 


2.  Notation  and  problem  formulation. 

The  following  notation  will  be  used  throughout  the  paper.  For 
-co  <  a  <  b  <  +  00,  Lp(a,b;Rn)  is  the  usual  Lebesque  space  of  equi¬ 
valence  classes  of  all  functions  x:[a,b]  -  Rn  such  that  jx|P  is  in- 
tegrable.  Let  y  =  [0,r]  where  r  >  0  is  a  fixed  real  number,  and 
Z  will  denote  the  Hilbert  space  Z  =  Rn  x  L2(-r,0;Rn).  For 
0  <  t  s  r,  the  space  Rn  x  L>2(*T,0;Rn)  will  be  denoted  by  Z(t).  The 
Sobolev  space  W^^ (-r,0;Rn)  consists  of  all  functions  in  L2(-r,0;Rn) 

with  derivatives  also  in  L2(*r,0)  and  norm  given  by 
2  2  *2 

]<p |  ( 1  ^  ) l  +  |<p|L  •  We  assume  that  ,1  and  s  are  compact  con¬ 

vex  subsets  of  R^1  and  Z,  respectively.  Moreover,  S  is  assumed  to 
have  the  property  that  if  9  €  S  and  0  <  T  <  r,  then  the  projected 


i 


function 


(2.0) 


cp(s)  = 


C?(s)  ,  -T  £  S  £  0  , 


-r  s  s  <  -t 


also  belongs  to  S. 

Let  Q  =  Q  x  y  and  F  =  S  x  Q»  so  that  a  generic  element  of  f  haf 
the  form  v  =  (Tl»cp,q)  =  (T]>cpsa,T).  The  elements  V  of  F  ate  called 


the  system  parameters.  We  assume  that  for  each  a  £  Q,  A0(a),  A^q) 
belong  to  R°  x  n,  B(a)  £  Rn  X  m,  C(or)  £  Rkxn,  D(a)  t  Rk  x  m  and  K(a,.) 
is  an  n  x  n  matrix  valued  function  with  columns  in  L2 (-r,0;Rn) . 

If  x :  [ -r ,  +  oo)  _  Rn  and  t  &  0,  the  function  x  :[-t  ,0]  -  Rn  is 
defined  by  xt(s)  =  x(t+s).  For  q  =  (a,r)  £  q,  the  operator  L(q)  is 
defined  by 

0 

L(q)cp  =  A0(cOcp(0)  +  A1(a)9(-T)  +  ^  K(a,s)cp(s)  ds. 

-T 

We  consider  the  system  governed  by  the  linear  retarded  functional 
differential  equation 


(2.1) 


x(t)  =  L(q)xt  +  B(or)u(t) ,  t  a  0, 


with  initial  data 


(2.2) 


x(0)  =  ^  ,  xn  =  <p  , 


and  output 


(2.3) 


y(t)  *  C(ar)x(t)  +  D(»)u(t)  , 
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where  u  is  a  Rm  —  valued,  locally  integrable  control  function  and 
(TJ,<p )  €  Z.  Given  a  control  u  and  y  €  f»  the  solution  of  the  initial 
value  problem  (2.1)-(2.2)  at  time  t  will  be  denoted  by  x(t;y,u). 

The  corresponding  output  to  (2.1)-(2.3)  at  time  t  a  0  will  be  denoted 
by  y(t;y,u). 


REMARK.  Note  that  the  initial  function  cp  need  only  be  defined 

on  [-T,0].  If  t  <  r  and  cp  €  ^(-t.OjR11)  we  shall  identify  cp  with 

the  projected  function  $  €  L^-r.OjR11)  defined  by  (2.0).  With 

this  understanding,  any  function  in  L^C-t.OjR11)  is  also  an  element 

of  L,2(-r,0;Rn).  Consequently,  for  notational  convenience  we  shall 

not  distinguish  between  ep  £  L2(~T,0;Rn)  and  cp  £  l^C-r.OjR0). 

We  shall  be  concerned  with  the  system  on  a  fixed  finite  interval 

[0,T]  where  T  >  0.  The  matrices  G  and  W  are  n  x  n  symmetric  positive 

semi-definite,  R  is  an  m  x  m  symmetric  positive  definite  matrix  and 

Yj,  yj»  •••»  yM  are  given  "observations"  in  Rk  at  times  t^, 

0  £  t,  <  t„  <  •••  <  tu  s  T.  The  above  notation  is  summarized  in 
1  £.  M 

the  following  list  of  nomenclature: 

rxSxQxSxOx»  -  Parameter  set 

Y  *  (T]><P,q)  =  (T],^,o,t)  -  System  parameters 

G,  W -  Syrian,  positive  semi-definite 

R  -  Symm.  positive  definite 


T 


Fixed  final  time 


Observation  times 


0  s  tj  <  •••  <  tMs  I 
yl’  y2 ’  ***»  yM - Observations. 

We  now  formulate  two  infinite  dimensional  optimization  problems 
associated  with  the  hereditary  system  described  above. 

The  identification  problem  may  be  stated  as  follows: 

PROBLEM  (ID).  Given  the  control  u  in  L2(0,T;Rm)  and  observations 
_  ic 

yi  €  R  ti,  find  the  system  parameters  Y*  €  r  which  minimizes 

the  fit  error 

(2.4)  E(y)  =  lyCt^Y^-yJ2  , 

iihere  y(t;y,u)  is  the  output  to  (2.1)-(2.3),  and  the  minimization 
takes  place  over  p . 

T*16  QRtimal  control  problem  may  be  stated  as  follows: 


PROBLEM  {OCX.  Given  the  system  parameters  y  €  T,  find  a 

-°-t'ro1  u*  L2(0,T;Rm)  which  minimizes  the  perform/in™  criterion 

T 

(2.5)  J(U)  =■  %[x  (T)Gx(T)]  +  k  {xT(s)Wx(s) +uT(s)Ru(s)}  ds, 

0 

where  x(t)  =  x(t;y,u)  _is  the  solution  to  the  system  (2.1)-(2.2). 
The  optimal  cost  will  be  denoted  by  J*  (i.e.  J*  =  J(u*)). 
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Ic  should  be  noted  that  the  above  formulation  of  the  identif 
cation  problem  allows  for  the  case  where  some  of  the  system  para¬ 
meters  y  =  (T),5P»®»t)  are  known. 
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3.  ’  The  abstract  Cauchy  problem  and  approximations . 

In  order  to  implement  any  numerical  algorithm  for  solving  the 
identification  and  optimal  control  problems,  it  is  necessary  to  in¬ 
troduce  approximations  at  some  stage  of  the  solution  process. 

The  basic  idea  used  in  this  paper  is  to  approximate  the  hereditary 
system  by  an  ordinary  differential  system.  We  give  a  brief  outline 
of  the  general  framework  and  present  two  particular  schemes.  Details 
of  the  method  may  be  found  in  £2],  f3]  and  [5"1. 

It  is  helpful  to  formulate  the  hereditary  system  (2.1)- (2.3)  as 
an  abstract  system  in  the  Hilbert  space  Z.  Although  this  formulation 
is  not  essential  if  one  is  concerned  only  with  numerical  results,  it 
is  informative  and  indeed  necessary  if  one  is  to  fully  understand 
the  basic  ideas  underlining  the  methods  to  be  discussed  here. 

Given  q  =  (a.T)  €  Q  X  M>  define  for  t  i  0  the  mapping 
S  (t  ;q)  :  Z(t  )  —  Z(T)  by 

S(t;q)(7],sp)  =  (x(t;q) ,  xt(*’,q)) 

where  x(*;q)  is  the  solution  to  the  homogeneous  equation  x(t)  ■  L(q)x 
with  initial  condition  (x(0),Xq)  =  (T[»cp) .  It  is  well  known  that  for 
each  fixed  q, fS(t;q)}t^Q  is  a  C^-semigroup  on  Z(t)  (see  [2],  [3"1). 
Moreover,  the  infinitesimal  generator  of  [S(t,q)}t^Q  is  the  operator 
a(q)  defined  on  the  domain 

J9(a(q))  =  {(TMP)  €  Z(t)  |  cp  €  W^1 }  (-t  , 0;Rn) ,  p(0)  =  7]] 


by 
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/ 


a(q)  (T]}<p)  =  (L(q)<p,cp)  • 

in  lc 

Define  JJ(q):R  -  Z(r)  and  C(q):Z(T>  -•  R  by  8(q)u  =  (B(a)u,0) 
and  C(q)  (T],cp)  =  C (oc)T],  respectively.  Corresponding  to  the  hereditary 
system  (2.1)-(2.3)  we  have  the  abstract  (ordinary  differential) 
system  in  Z(t) 

(3.1)  z(t)  =  a(q)z(t)  +  B(q)u(t), 

(3.2)  z(0)  =  (7]jCp)  , 

(3.3)  y (t)  =  C(q)z(t)  +  D(a)  u(t)  . 

A  mild  solution  to  (3.1)-(3.2)  is  given  by  the  variation  of  para¬ 

meters  formula 

(3  '  )  z(t;v»u)  -  S (t ; q)  (7],?p)  +  \  S(t-s;q)R(q)u(s)  ds. 

0 

The  following  result  is  fundamental  for  all  the  approximation 
methods  we  consider.  Its  proof  may  be  found  in  £4"*. 

THEOREM  3.1.  Suppose  that  V  =  (T],tp,  q)  £  T  and  u  £  L2(0,T;Rm) . 

If  x(t;y,u)  denotes  the  solution  to  the  hereditary  equation  ( 2 . 1 ) - ^ 
(2.2),  then  z  defined  by  (3.4)  satisfies 

(3.5)  z(t;y,u)  =  (x(t;Y,u),xt(* ;y,u)) 

for  all  t  a  0.  In  particular,  the  output  to  the  abstract  system 
(3.1)- (3. 3)  is  the  same  as  the  output  to  the  hereditary  system  (2.1)- 


(2.3). 


-8- 


It  is  clear  from  the  above  equivalence  that  the  hereditary 
system  (2.1)-(2.3)  can  be  approximated  by  approximating  the  abstract 
system  (3.1)-(3.3).  In  order  to  approximate  (3.1)-(3.3),  it  follows 
from  the  formula  (3.4)  and  the  equivalence  (3.5)  that  one  must 
approximate  the  following; 

i)  the  initial  data  (T],cp)> 

ii)  the  semigroup  {S(t;q)}ts_0> 

iii)  the  operators  j}(q),  C(q)* 

The  approximation  of  the  initial  data  is  accomplished  by  projecting 
(7|,cp)  onto  a  finite  dimensional  subspace  of  Z(t).  In  order  to 
approximate  S(t;q),  recall  that  S(t;q)  is  an  evolution  operator 
which  is  sometimes  written 


S(t;q) 


„a(q)t 

^  » 


even  though  Q(q)  is  unbounded.  However,  this  (formal)  identification 
illustrates  the  basic  idea;  S(t,q)  is  approximated  by  approximating 
Q (q) .  Similarly,  we  must  approximate  fi(q,  and  f(q).  Consequently, 
we  construct  approximating  systems  to  (3.1) -(3. 3)  (and  hence  (2.1)- 
(2.3))  by 


1)  projecting  (T),cp)  onto  some  finite  dimensional  sub¬ 
space  of  Z(t), 

and 

2)  approximating  the  operators  a (q) »  B(q)  and  C(q)> 
Although  the  above  remarks  are  based  on  formal  ideas,  the 
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steps  outlined  above  can  be  effected  in  a  rigorous  mathematical 
framework.  We  shall  not  attempt  to  develop  the  relevant  theory  in  this 
paper;  rather  we  refer  the  interested  reader  to  [5]. 

We  turn  now  to  the  two  particular  schemes  that  we  have  tested 
rather  extensively  on  a  number  of  numerical  examples.  The  first  method 
(AVE)  is  based  on  step-function  approximations  to  the  initial  function 
cp,  while  the  second  method  (SPLINE)  is  based  on  linear  spline 
approximations  to  qj . 


N  -  ir 

AVE :  Corresponding  to  the  partition  t^  =  — jjp ,  j  =  0,1,  •••,N,  of 

[  — t  , 0 j,  we  define  the  subspace  Z^(t'  =  {(7|,cp)  €  Z(t)  |  tp  is  a  constant 

N  N  N 

on  each  of  the  subintervals  [t^,  tj _^)].  Let  P^(t)  be  the  orthogonal 

N 

projection  of  Z(t)  onto  the  closed  subspace  In  particular. 


with 


PaCO(1),<p)  =  (T],cpN) 


N  N  N  N,  , 

<P  (s)=  2  Vx  X,(s)  , 
j=l  J  J 


N  N  N  N 

where  / .  (s)  is  the  characteristic  function  for  [t.,  t.  .)  and  u.  is 
j  u  j  j  - 1  Tj 


the  mean  (average)  value 

N  _  N  r  J  ~  .  ,  , 

Cpj  —  —  \  <p(s)  ds  » 


‘U 


tN 

J 


j  =  1,  2,  •••  N.  We  take  (T,,9  )  for  our  approximation  to  the 


initial  data  (T],'?).  To  approximate  d(q),  observe  that  the  first 


•  t- . 


-11- 


(3.6)  A  (q)  = 


A0(oi)  Kj(a)  •  •  •  KjJ^Ca)  A1(a)+Kj(a) 


h  -fi 


o  ?i  -fi 


0  ~I 


where  I  is  the  n  x  n  identity  matrix.  The  [(N+l)n] x  m  matrix 
BN(q)  and  the  k  x  [(N+l)n]  matrix  CN(q)  are  defined  by 


(3.7) 


Aq) 


B<«) 

0 


0 


and  C  (q)  =  [C(a)  0  ...  0]  , 


respectively. 

The  approximating  ordinary  differential  system  (of  dimension 
(N+l) n  is  given  by 


(3.8) 


zN(t)  =  AN(q)zN(t)  +  BN(q)u(t) 


(3.9) 


N...  N 
z  (0)  =  zQ 


(3.10) 


yN(t)  =  CN(q)zN(t)  +  D(«)u(t)  , 


-12- 


N  N  N 

where  zQ  =  colCTj.cp^  •  •  •  »<PN>-  The  approximate  system  (3.8)-  (3-10) 
will  be  referred  to  as  the  AVE  approximation  to  (2.1)  -  (2.3). 


SPLINE :  Corresponding  to  the  partition  t^  =  — jj3*,  j  =  0,1, 
of  r-,0]  we  define  the  subspace  ^  (t  )  =  {(cp(0),cp)  £  Z  (t  )  |  cp  is  a  l  irst 

order  (piecewise  linear)  spline  function  with  knots  at  t^, 1  =  0,1 . N. 

N  N  * 

Let  Pg(-r )  be  the  orthogonal  projection  of  Z(t)  onto  Zg(T).  Note 

N 

that  if  (T],cp)  g  Z(t),  then  Pg(r)(T],cp)  belongs  to  MG(q))-  006  can 
N 

argue  that  Ps(t)(71,cp)  —  (7]>«p)  as  N  -.  -txo  and  hence  it  is  not  un¬ 
reasonable  to  expect  that  for  ('■',, y)  6  i>(G(q)) 

lim  p”(t)  a(q)p”(T)(T),cp)  =  G(q)  (7]>cp)  • 

K-^-cc  15  b 

Consequently,  we  define  C?N(q):ZN(T)  -»  Z^(t)  by 

S  S 


(3.11) 


N  N  N 

0  (q)  =  Pg(T)  C(q)  Pg(T). 


In  order  to  represent  the  operator  Q  (q)  and  construct  an 

ordinary  differential  system  in  Euclidean  space,  we  follow  the 

N 

general  outline  given  by  Banks  and  Kappel  [8].  Let  , j=0, 1, • • • ,N 
denote  the  scalar  first  order  spline  function  on  [-t,0]  characterized 


■  6tj.  i.  j  -  0,  1,  ...  !i  , 

where  y.  is  Che  Kronecker  symbol.  The  matrix  =  tB,. • • • . 


defined  by 


„N  r  N  N  N.„  T 

8  =  [e0»  V  •••»  I 


-13- 


(where  3  denotes  the  Kronecker  product)  is  such  that  the  set 


a  w  N  N 

b"  »  (Bj(0),  ) 

N  N 

j  -  1,2,  ...,N+1,  forms  a  basis  for  Z  (T).  With  this  basis  Z,(~) 

o  s 

(N-f-l)n 

is  identified  with  R  and  the  following  system  may  be  con¬ 

structed  . 


Let  Q  (q)  be  the  [(N+l)n]  x  [ (N+l)n]  matrij 


(3.12)  Q"(q)  -  - 


N  1 
-  +  3 


1 

6 


and 


(3.13) 


N  N  N 

H  (q)  -  H^(q)  +  ll”(q) 


where 

N  N 

H^(q)  and  ^(q)  are  [(N+l)n]  x  [ (N+l)n]  matrices  defined  by 


*  • 


N, 


(3.14)  H  (q)  - 


Ao(Q) +  Ko(t>)  l?(a)  •  •  • 

0  ...  0 


I 


wi  Lh 


Kj(a)  =  ^  K(a,s)  e^(s)  ds  , 


-r 


and 


It  follows  (see  [  8  ])  that  aN(q)  =  PN(T  )(?  (q)?V  )  i,as  thl 

s  s 

[(ffH)n]  x  [(N+l)n]  mat  rix  representation 


/ 
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(3.16) 


7N,  x  r„N,  .,-1  „N.  . 

A  (q)  =  [Q  (q)]  H  (q)  . 


Define  the  [(N+l)n]  x  m  matrix  B  (q)  and  the  k  x  [ (N+l)n]  matrix 


CN(q)  by 


(3.17)  £N(q)  =  ^QW(q) 


N  .  -1 


B(o) 

0 


and  ^(q)  =  [c(«)  o  ...  o;, 


re 


spectively.  Any  vector  zN  £  ^(t )  can  be  written 


as 


N  «  ,  N,-,.  N.  N 

z  =  I  (e  (0),e  )|  . 

j=0  3  J  J 

N  n  N  N 

where  £  €  R  •  Thus,  the  vector  z  €  Z^COcan  be  identified  with  the 

vector  c°K  '  *  *5^)  in  R(N+1)n> 

The  approximating  ordinary  differential  system  becomes 

(3.18) 


zN(t)  =  AN(q)zN(t)  +  BN(q)u(t)  , 


(3.19) 

(3.20) 


N.,n.  N 

*  (0)  =  zQ  , 


yN(t)  -  CN(q)wN(t)  +  D(cr)u(t)  , 


where  z!J  is  the  vector  in  R(N+1)n  identified  with  PN(T )  (T] , cp )  t  ZN(t). 

b  S 

We  shall  refer  to  the  system  (3.18)  -  (3.20)  as  Lie  Sl’l.lNK  approximation 
scheme  for  (2.1)  -  (2.3). 


REMARK.  When  making  computations  involving  the  spline  system 

N  - 1 

(3.18)-(3.20)  one  never  actually  computes  [Q  (q)]  but  rather 
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solves 

rJ,  N  „N .  .  N 
IQ  (q)]w  =  H  (q)v 

directly  in  order  to  obtain  wN  =A^(q)vN. 

Both  of  the  above  schemes  (AVE  and  SPLINE)  fall  within  the 
general  theoretical  framework  presented  in  [5],  where  convergence 
results  and  error  estimates  are  given. 

4.  The  approximating  problems . 

t 

The  system  (3.8)-(3.10)  will  be  called  AVE  and  the  system 
(3 . 18) - (3 .20)  will  be  called  SPLINE.  Both  are  ordinary  differential 
systems  (of  dimension  (N+l)n)  that  approximate  the  dynamical 
response  of  the  hereditary  system  (2.1)-(2.3).  In  order  to  state 
an  approximating  identification  problem,  we  must  approximate  the 
constraint  set  p. 

Suppose  that  y  =  <T],<P,q)  €  V  and  that  P^(t)(^,9)  and  P^(0  ("„«>) 
have  the  representations  in  given  by 

p^(t)(T],5p)  •••,<(>”) 

_N.  w  .  .  N  N  N, 

Ps(T)<T),«p)  -  • 

Let  and  Hg  denote  the  mappings  from  Z  x  R^1  x  R  to  r^1)1^  Ru  x  R 

n”(Tl,<P,a,T)  =  (pJJ(T)(Tl,cp),a,T) 


defined  by 
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Hg  (T)>5P  >  ®>T  )  =  (Pg(T)(ll,Cp).Qf,T)  . 

Thus  motivated,  we  choose  the  approximating  constraint  sets  as 
N  N  N  N 

A  ■  ~A  T  and  fg  =  rig  T.  For  each  of  the  systems  (3.8)  -  (3.10)  and 
(3.18)  -  (3.20)  we  have  the  following  approximating  parameter  ident¬ 
ification  problem: 


PROBLEM  (IDN).  Given  the  control  u  _in  L^O.TjR™)  and  obser¬ 
vations  y ^  £  Rk  at  times  t^,  find  the  parameters  ya  £  fA  Gg  c*rg) 
which  minimizes  the  fit  error 


(4.1)  eV)  =  *? 

i=l 


N.  .  N  .  ~  ,2 

y  (t.;y  ,u)  -  yt  | 


where  yN(t;yN,u)  is  the  output  to  the  AVE  system  (3.8)-(3.10) 

(SPLINE  system  (3 . 18 )— »  3.20)),  and  the  minimization  takes  place 

over  r.  (°ver  -  c)  . 

-  A  S 


Given  a  parameter  y  =  ('f]>V>a>T),  one  may  construct  the 

approximating  systems  AVE  and  SPLINE,  corresponding  to  y.  Let 
N  N 

G  and  W  be  the  (N+l)n  square  matrices  defined  by 
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G 


N 


G  0 
0  0 


0 


and 


0 


0 


N 

W  = 


W  0 
0  0 


0  0 


0 


>J 

u 

I] 

1J 

il 


0 


Vi 


For  each  of  the  approximating  systems  AVE  and  SPLINE  we  have 
the  following  approximating  optimal  control  problems: 

PROBLEM  (OCN) .  Given  the  system  parameters  y  6  T»  find  a 
control  (u^)  in  L2(C,T;Rm)  which  minimizes  the  performance 
criterion 

T 

(4.2)  JN(u)=  *[(zN(T))TGNzN(T)]  +  %  ^  {(zN(s))TWNzN(s)+uT(s)Ru(s)}ds, 

0 

N  N 

where  z  (t)  =  z  (t;y,u)  is,  the  solution  to  the  AVE  system  (3.8)- 

(3.10)  (SPLINE  system  (3 . 18) - (3. 20)) .  The  optimal  cost  will  be 

.  „  .  ,  *N,.  «N  ,N.N„ 

denoted  by  J  (i.e.  J=J  (u)). 


i  l 


i  1 


11 

Q 

a 


For  each  N,  the  approximating  identification  and  optimal 
control  problems  are  now  finite  dimensional  in  the  sense  that  the 
dynamical  systems  AVE  and  SPLINE  are  governed  by  ordinary  differ¬ 
ential  equations  in  R^N  ^n.  The  basic  idea  is  to  solve  (for 

fixed  N)  each  of  these  problems  to  obtain  <yN,  uN  and  uN.  It 

ASA  S 

can  be  shown  that  under  reasonable  conditions  CN  and  CN 

yA  ys 

"converge"  to  \*  and  u.  and  u  converge  to  u*  (see  [  5 ]  for  a  pro- 

A  D 

cise  statement  of  the  results). 

The  remainder  of  this  paper  is  devoted  to  the  study  of  numer¬ 
ical  examples.  In  particular,  we  compute  y^,  y*J,  u^  and  uN  and 
compare  these  values  with  the  optimal  values  y*  and  u*  for  a 
number  of  hereditary  systems.  In  doing  so,  we  hope  to  demonstrate 
that  the  method  is  feasible  to  implement  and  that  acceptable  con¬ 
vergence  rates  are  obtained. 

All  of  the  numerical  results  presented  in  the  next  sections 
were  produced  by  computer  programs  written  at  Virginia  Tech  and 
Brown  University.  The  identification  problems  were  run  at  Virginia 
Tech  on  an  IBM  370/158  computer.  A  maximum  likelihood  (least 
squares)  algorithm  was  used  to  solve  the  approximating  problem  (IDN). 
A  complete  discription  of  the  method  and  listing  of  the  code  may  be 
found  in  the  report  [9].  The  optimal  control  problems  were  run  at 
Brown  University  on  an  IBM  360/67  computer.  For  both  the  linear 
and  nonlinear  control  examples  a  conjugate-gradient  minimization 
algorithm  (as  described  in  [  1  ])  was  used  to  solve  the  approximat ing 
problem  (OCN) . 
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5.  Numerical  solutions  to  the  identification  problem. 

In  this  section  we  present  a  number  of  numerical  results  for 
the  identification  problem  (PROBLEM  (ID)),  that  are  based  on  the 
approximation  schemes  (AVE  and  SPLINE)  outlined  in  the  previous 
sections.  In  order  to  generate  most  of  the  data  for  testing  the 
algorithm  we  select  a  "true"  set  of  parameters  y*=  (T)*,y*, a*,T*) 
and  a  control  u  and  use  the  method  of  steps  [11]  to  solve  for  x 
on  the  interval  [0,T]. 

In  all  of  the  examples  presented  below  we  used  t*  =  1  and 
u  =  u  ,  where  u  is  the  unit  step  at  t  =  l  defined  by 

0  t  <  t  , 

v*>  -  < 


^  1  (St, 

and  0  <  JL  <  1.  The  final  time  of  T  =  2  was  used  in  most  of  the 
examples  (except  05.1).  The  observations  y^  =  y(t^)  were  generated 
at  101  equally  spaced  time  steps  on  [0,T].  In  some  examples  noise 
was  added  to  the  model  to  produce  "noisy  observations" 


y(t)  =  y (t)  +  v(t)  , 


where  v(t)  =  col(v^(t) , • • *,v^(t))  is  a  computer  simulated  vector 
of  normal  random  variables  v^(t)  (routine  GGNQF  of  the  IMSL  library, 
see  IMSL  Users  Guide),  each  with  zero  mean  and  preset  standard 


variation. 
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For  each  fixed  N,  the  approximation  Problem  (IDN)  was  solved 
using  a  maximum  likelihood  estimator  (MLE) .  Since  the  MLE  is  an 
iterative  procedure  it  is  necessary  to  supply  a  startup  (i.e.  an 
initial  guess)  for  the  optimal  parameter  y^  (or  y^  for  the  spline 

scheme).  If  g  denotes  an  unknown  parameter  to  be  estimated  (i.e. 

NX  ~N 

g  =  or  or  g  =  t,  etc),  then  g  ’  will  denote  the  estimate  for  g 

obtained  after  I  iterations  of  the  MLE  applied  to  PROBLEM  (IDN). 

N  0 

The  startup  value  will  be  denoted  by  g  *  . 

It  is  helpful  to  understand  the  numbering  system  for  the 
identification  examples.  The  first  two  characters  in  the  example 
number  indicate  what  model  is  used  for  the  generation  of  data.  The 
number  after  the  decimal  point  refers  to  the  specific  numerical 
run.  For  example,  all  "S2"  examples  are  problems  where  the  "true" 
system  is  governed  by 

x(t)  =  .05  x(t)  -  4.0  x(t-l)  +  u  ^(t)  , 

Xq(s)  =  1  ,  -1  £  s  s  0  , 

y(t)  =  x (t )  . 

In  EXAMPLE  S2.1  we  assume  that  a£  =  -4.0  is  unknown  and  attempt 
to  estimate  this  parameter,  while  in  EXAMPLE  S2.2  we  assume  that 
the  time  delay  r*  =  1.0  is  unknown  and  estimate  this  parameter. 


etc . 
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The  figures  are  labeled  at  the  top.  In  the  left  hand  comer 
the  lettering  indicates  the  example  number,  the  value  of  N  and  the 
approximation  scheme.  For  example,  S2.1N16A  refers  to  Example 
S2.1,  N  =  16  and  the  AVE  procedure.  The  lettering  in  the  right 
hand  corner  represents  iteration  number  in  the  M1E  algorithm. 

1 


t 
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ID  MODEL  S2 

This  is  a  simple  scalar  model  with  discrete  delay.  The 
system  is  governed  by 

x(t)  =  .05  x(t)  -  4.0  x(t-l)  +  u  ^(t)  , 

with  initial  data 

x(0)  =  1  and  Xq(s)  =  1  ,  -1  s  s  <  0. 

The  output  is  simply  the  state  at  time  t,  viz: 

y (t)  =  x(t)  . 

As  described  above,  this  system  was  analytically  integrated  (using 
the  method  of  steps)  to  construct  the  solution  on  [0,2].  The 
resulting  solution  was  evaluated  at  101  equally  spaced  points  to 
generate  data  for  the  following  four  examples;  S2.1-S2.4. 
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EXAMPLE  S2.1 


In  this  initial  example  we  consider  the  problem  of  identifying 
a  single  parameter,  namely  the  coefficient  of  the  delayed  term  in 
the  model  S2.  Thus,  in  our  parametric  model  the  dynamics  are  des¬ 
cribed  by 


x(t)  =  .05  x(t)  +  a^x(t-l)  +  u  ^(t) 

with  initial  condition 

x(0)  =  1  ,  xQ(s)  s  1  ,  -1  s  s  <  0  , 

and  output 

y(t)  *  x(t)  . 

For  N  =  2,  4,  8,  16  and  32  the  resulting  Problems  (IDN)  were 
"solved"  using  a  version  of  the  computer  code  described  in  [9]. 
Since  the  numerical  algorithm  is  iterative,  it  is  necessary  to 
provide  a  "start-up"  value  for  a^  and  in  this  example  we  used 

N,  0 

a^  =  0.0  . 

A,  N 

The  algorithm  provides  a  sequence  of  "improved"  estimates  for  a^ 

and  will  terminate  when  either  a  maximum  number  of  iterations  is 

N 

achieved,  or  when  the  norm  of  the  gradient  of  E  is  less  than  10 


In  the  latter  case  we  claim  that  the  procedure  has  "converged". 


Results  of  the  numerical  experiments  for  this  example  are 
shown  in  Table  S2.1.1.  Notice  that  for  N  =  2,  the  AVE  procedure 
had  not  "converged"  at  10  iterations,  and  that  the  SPLINE  estimate 
of  the  parameter  at  N  =  4  is  better  than  the  AVE  estimate  at  N=32. 

By  using  the  parameter  values  we  can  estimate  the  rate  of 
convergence  as 


am 

where  e„  =  y  -  Y*  is  the  error.  From  N  =  2  in  the  SPLINE  estimates 
N 

we  find  6  1.7,  while  for  N  =  4  in  the  AVE  result  we  estimate 

5  2  .12.  Such  estimates  for  the  rates  of  convergence  must  be 
viewed  with  caution  because  the  numerical  values  are  corrupted  by 
sources  of  error  other  than  the  approximation  scheme. 

Figures  S2.1.1  and  S2.1.2  show  the  converged  data  fits  at 
N  =  16  for  AVE  and  SPLINE,  respectively.  The  N  *  32  results  are 
essentially  the  same  as  those  for  N  =  16. 

Since  computer  requirements  are  of  practical  interest,  we 
note  that  for  N  =  32,  the  AVE  algorithm  took  about  15  sec.  per 
iteration,  while  the  SPLINE  procedure  required  a  little  over  16 
sec.  per  iteration.  This  comparison  is  not  completely  fair 
because  the  majority  of  the  code  used  is  common  to  both  AVE  and 
SPLINE  and  it  is  structured  to  provide  the  generality  needed  for 


EXAMPLE  S2.2 


In  this  example  we  consider  the  problem  of  identifying  the 
time  delay  alone,  with  all  other  parameters  known.  Thus,  the 
parametric  model  of  the  system  is 

x(t)  =  .05  x(t)  -  4.0  x(t-r)  +  u  ^(t) 

with  initial  condition 

x(0)  55  1  ,  Xq (s )  =  1  ,-r  s  s  <  0  , 

and  output 


y (t)  -  x(t)  . 


As  before,  we  conducted  numerical  experiments  for  N  =  2,  4,  8, 
16  and  32.  Our  start-up  was 


while  the  true  value  is  of  course  r*  =  1.0.  At  N  *  2  and  N  *  4 

an  interesting  phenomenon  appeared;  namely,  for  the  start  up  value 
N  0 

of  r  ’  =0.5  the  AVE  procedure  "converged"  and  the  SPLINE  pro¬ 

cedure  "diverged".  To  examine  the  causes  of  this  result  we 

4 

evaluated  the  cost  function  E  for  AVE  and  SPLINE  at  a  variety  of 
r  values.  The  interesting  results  of  this  investigation  are  shown 
in  Figure  S2.2.1.  It  happens  that  the  SPLINE  cost  function  is 
more  "oscillatory"  than  the  AVE  cost  function  for  N  =  4.  Both 


have  two  local  minima.  However,  the  SPLINE  cost  function  is  such 
4  0 

that  the  start  up  r  ’  =  0.5  is  not  in  the  valley  of  the  "global" 

lx  4.0 

minimum  (rg  =  .9972),  while  for  the  AVE  procedure,  r  =  0.5  is 

in  the  valley  of  the  global  minimum  (r^  =  1.2001). 

When  the  cost  function  has  more  than  a  single  local  minimum, 

the  system  is  said  to  suffer  a  lack  of  (global)  identif iability 

(at  least  for  the  specified  input).  In  such  cases  it  is  important 

to  have  good  start-up  values  for  the  parameters. 

Table  S2.2.1  illustrates  the  convergence  for  this  example. 

Note  that  for  the  reasons  outlined  above,  different  start-up 

values  were  used  for  AVE  and  SPLINE .  Again  the  results  show  that 

for  N  =  2  the  SPLINE  algorthim  gives  better  estimates  of  the 

parameter  r  than  AVE  for  N  =  32.  Figures  S2.2.2  and  S2.2.3  show 

the  N  =  4  data  fits  for  AVE  and  SPLINE,  respectively. 


AVE 

N,0  n  c 
r  *  0.5 

SPLINE 

rN’°  *  0.8 

le_.  1 

"N 

|e__l 

N 

r 

1  N' 

N 

r 

2 

1.4603 

.4603 

2 

1 . 0084 

.0084 

4 

1.2001 

.2001 

4 

.9972 

.0028 

8 

1.0923 

.0923 

8 

.9983 

.0017 

16  1.0439  .0439 

32  1.0212  .0212 


r*  = 


1.0000 


FIGURE  S2.2.2 
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EXAMPLE  S2.3 


In  this  example  we  consider  the  problem  of  estimating  the  two 
coefficients  in  the  model.  Therefore,  the  system  is  modeled  by 

x(t)  =  aQx(t)  +  a^x(t-l)  +  u  ^t) 

with  initial  data 

x(0)  =  1  ,  Xq (s  )  =  1  ,  -1  s  s  <  0  , 

and  output 


y(t)  =  x(t)  . 

Numerical  runs  for  N  =  2,  4,  8,  16  and  32  were  conducted.  The 
start-up  values  for  a*  =  .05  and  a*  =  -4.0  were  chosen  to  be 


.03  and 


N.O 

al 


-3.0  . 


Table  S2.3.1  contains  a  summary  of  the  estimates  for  both  AVE  and 
SPLINE.  The  ^  errors  (lag  -  a* I  +  la^  -  a* | )  are  given  in  Table 
S2.3.2.  Note  that  the  SPLINE  estimate  at  N  *  4  is  better  than  the 
AVE  estimate  at  N  =  32. 

Figures  S2.3.1  and  S2.3.2  show  the  converged  data  fits  at 
N  =  16  for  AVE  and  SPLINE,  respectively.  Observe  that  the  SPLINE 
procedure  provides  almost  a  "perfect"  match  to  the  data. 


1 


SPLINE 


0 


1.0869 

.6525 

.3825 

.2245 

.1384 

.0500 


-4.6236  2 
-4.3160  4 
-4.1660  8 
-4.0898  16 
-4.0505  32 

-4.0000  y*  = 


TABLE  S2.3.1 


.0995 

.0417 

.0439 

.0449 

.0454 

.0500 


-4.1639 

-4.0523 

-4.0222 

-4.0151 

-4.0133 

-4.0000 


AVE 

SPLINE 

N 

I*n! 

N 

leN! 

2 

1.6605 

2 

.2134 

4 

.9185 

4 

.0606 

8 

.4985 

8 

.0283 

16 

.2643 

16 

.0202 

32 

.1389 

32 

.0179 

TABLE  S2.3.2 
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EXAMPLE  S2 .4 

This  is  the  first  example  in  which  the  "original"  identification  prob¬ 
lem  is  truly  infinite  dimensional.  In  particular,  we  seek  to  estimate 
the  initial  data  (7],cp)  £  R  x  L^C-l,  0;  R)  and  the  coefficient  of  the 
delayed  term.  Thus  our  model  is  described  by  the  scalar  equation 

x(t)  =  .05  x(t)  +  a^x(t-l )  +  u  ^(t)  , 

with  (unknown)  initial  data 

x(0)  =  Ti  ,  Xq ( s )  =  cp  (s)  ,  -1  s  s  <  0  , 

and  output 


y(t)  *  x(t)  . 


For  each  N  =  2,  4,  8,  16  and  32,  the  approximating  problem  (IDN) 
was  formulated  as  discussed  in  Section  4.  Thus,  for  AVE  we  seek 
the  "parameter" 

~N  _  N  N  N 

Ya  ~  CT|.cp1»92>  '"»cPN>aiJ  » 

N  N  N 

where  ,cp2 » '  *  *  »<pN)  represents  the  projection  of  the  initial 

data.  Similarly,  for  SPLINE  we  seek  the  "parameter" 


N  _N  N 

where  <5q>  5^ » » * '  ’  >  represents  the  SPLINE  projection  of  the  initial 
data.  The  "start-up"  for  (71,9)  6  R  x  L^C-l,  0;  R)  is  the  zero 
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initial  data  (0,0),  while  its  true  value  is  (1,  1).  The 
"start-up"  for  a*  =  -4  is 

N,0  _  .  . 

=  -3.0  . 

Table  S2.4.1  provides  an  overview  of  the  results.  Because  the 

initial  data  is  in  R  x  I^C-l,  0;  R)  we  have  only  displayed  the 

N 

Z-norm  of  the  error  and  the  estimated  value  for  a^.  The  com¬ 
parison  of  the  two  schemes  is  quite  striking,  particularly  the 
relative  ability  to  estimate  the  initial  data.  Shown  in  Figure 
S2.4.1  are  graphs  of  the  true  initial  data  and  the  corresponding 
estimates  produced  by  AVE  and  SPLINE  for  N  =  4.  It  is  apparent 
at  least  for  the  chosen  "start-up"  values  that  the  SPLINE  pro¬ 
cedure  readily  finds  good  estimates  for  the  parameters,  while  the 
AVE  scheme  has  considerable  difficulty. 

It  is  interesting  to  compare  the  sequences  of  data  fits 
generated  as  the  iteration  procedure  evolves.  Figures  S2.4.2 
through  S2.4.4  show  the  data  matches  from  the  AVE  algorithm  for 
iterations  0,  4  and  9,  respectively.  From  the  match  at  iteration 
4  (Figure  S2.4.3)  it  might  be  deduced  that  AVE  is  in  trouble.  How¬ 
ever,  at  iteration  9  the  fit  is  quite  good  and  Figure  S2.4.4  does 
not  give  any  hint  of  the  poor  values  of  the  parameters  indicated 
in  Table  S2.4.1. 

Figures  S2.4.5  through  S2.4.7  illustrate  the  SPLINE  data 
matches  at  iterations  0,  4,  and  9  respectively.  Again  the  iteration 
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4  matches  indicate  some  difficulty  while  by  iteration  9  the  match 
is  quite  good.  It  happens  that  the  SPLINE  estimates  of  the  para¬ 
meters  are  excellent. 

Although  one  can  not  be  certain,  it  does  appear  that  AVE  is 

N 

converging  to  a  local  minimum  of  E  .  As  in  example  S2.2  we 

suspect  that  the  IDN  problem  for  AVE  suffers  a  lack  of  identifiability . 

The  IDN  problem  for  SPLINE  seems  to  be  much  better  behaved. 

In  order  to  further  investigate  identifiability  for  problems 
with  unknown  initial  data  we  essentially  repeated  this  example 
with  identical  dynamics,  changing  only  the  initial  data  to 

Tj  "  1  ,  cp(s)  =  l  +  s,  -1  £  s  <  0  . 


Using  the  same  start-ups  as  above  we  found  that  SPLINE  converged 
for  all  N  values,  whereas  AVE  never  did.  Results  are  summarized 
in  Table  S2.4.2. 


AVE 

SPLINE 

N 

aN 

al 

ijz*(U)-zN(0)|j 

N 

/.N 

*1 

||z*(0)-zft»|| 

2 

-4.4103 

2.08 

2 

-4.4382 

.1595 

4 

-4.9924 

4.53 

4 

-3.9381 

.0867 

8 

-4.2651 

41.76 

8 

-4.0031 

.0287 

16 

did  not  converge 

16 

-4.0031 

.0201 

32 

did  not  converge 

32 

-4.0001 

.0386 

TABLE  S2.4.1 


AVE 


SPLINE 


N 

31 

||z*(0)-zN(0)j! 

N 

-N  . 
al  ' 

,z*(0)-$N(0)|| 

2 

2 

-4.5201 

.0563 

4 

did 

1 

not  converge 

4 

-4.0975 

.0318 

8 

8 

-4.0282 

.0123 

16 

16 

-4.0123 

.0193 

32 

32 

-4.0122 

.0936 

TABLE  S2.4.2 
(linear  initial  data) 


1 


S  2 . 4N8RV 


x(t)  =  .05x(t)  +  a^x(t-l)  +  u  ^(t) 
")  *  *n »  x_(s)  =  ^(s) 


I  TR=  0 


+  +  +  data 


a*  =  -4.0 


AVE  Model  a®’0  =  -3.0  ||z*(0)  -  z8,°(0)l|  =»  ft 


0.40 


0.  80 


1  .  20 


TIME 


FIGURE  S2.4.2 


-  -+■ 


T  (1) 


S2  .  4N8SP 


7 - i  I  T 


x(t)  =  .05x(t)  +  a^x(t-l)  +  u  ^(t) 
x(0)  =  T]  ,  xQ(s)  =  9<s) 


data 

SPLINE  Model 


I - 1 - 1 - 1- - 4 - { - f- 

00  0.40  0.80  1.20 

TIME 


FIGURE  S  2.4.6 


S2, 4N8SP 


TR 


_  x(t)  =  .05x(C)  +  a^x(t-l)  +  u  (t) 


x (0)  =  "  ,  x0(s)  =  9(s) 


a*  =  -4.0 


SPLINE  Model  a®’9  =  -4.0031 


1U*(0)  -  z8’  9  (0)  *'  -  .05 


-f - 1 - f - +—  f - I- 


0.40  0.80  l.«?0 


'TIME 


FIGURE  S2.4.7 
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ID  MODEL  01 

This  model  describes  a  (reasonably  realistic)  mechanical 
oscillator  with  retarded  restoring  and  retarded  damping  forces. 
The  system  is  governed  by  the  second  order  equation 

x(t)  +  36x(t)  +  2.5  x(t-l)  +  9x(t-l)  =  u  L(t) 

with  initial  data 


xQ(s)  =  1  ,  xQ(s)  =  0  ,  -1  £  s  £  0  , 
and  scalar  output  (which  represents  position) 

y(t)  =  x(t)  . 

This  second  order  equation  is  equivalent  to  the  two  dimensional 
system 


Xj^(t) 

0 

r 

xx(t) 

r~ 

0 

0  ~ 

x2(t-l) 

1 - 

o 

L 

d 

dt 

x2(t) 

-36 

_ 

0 

x2(t) 

+ 

-9 

-2.5 

x2(t-l) 

+ 

1 

with  initial  condition 


- ) 

X 

h-* 

_ 1 

r — 

t— i 

i _ 

(s)  H 

1 

<M 

X 

_ 1 

1 

O 

,  -1  s  s  £  0  , 
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and  output 


y(t)  =  [l  o] 


Xj^Ct) 

x2(t) 


This  system  was  integrated  forward  (using  the  method  of  steps)  to 
obtain  the  analytic  solution  on  [0,2].  Again,  data  was  generated 
at  101  equally  spaced  points  by  evaluating  the  true  solution.  This 
data  was  used  in  the  following  examples;  01.1  -  01.2. 
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EXAMPLE  01.1 


This  experiment  is  devoted  to  the  estimation  of  the  three 
coefficients  in  the  model.  Therefore,  we  assume  our  model  is 
described  by  the  second  order  equation 

2 

x(t)  +  is  x(t)  +  aQx(t-l)  +  a^x(t-l)  =  u  1  (t ) 
with  initial  data 

xQ(s)  =  1  ,  xQ(s)  =  0  ,  -1  S  s  s  0  , 


and  output 


y(t)  =  x (t)  . 


The  problem  is  to  estimate  uu,  a^  and  a^. 

Since  the  basic  system  is  two  dimensional  for  each  N  the  approx¬ 
imating  systems  for  AVE  and  SPLINE  is  of  dimension  2»(N  +1).  In 
order  to  keep  the  program  size  reasonably  small  (our  objective  is 
to  test  the  algorithms  and  not  to  develop  computer  codes)  we 
solved  the  approximating  identification  problems  for  N  =  2,  4,  8 
and  16.  This  allowed  us  to  use  the  same  code  for  scalar  and  two 
dimensional  systems  without  increasing  the  "size"  of  the  code; 
therefore  keeping  the  computing  cost  minimal. 

The  start-up  values  for  u>*  =  aQ  =  ^.5  and  a*  =  9  were 


N,0 


5.0 


N,0  _  . 
a0  "  l* 


a^’°  =  5.0  . 


-52- 


Tables  01.1.1  and  01.1.2  show  the  parameter  estimates  for 
AVE  and  SPLINE,  respectively.  Observe  that  the  N  =  16  estimates 
produced  by  the  AVE  procedure  are  such  that  the  "relative  L, 

leNl 

error"  — tt)  is  approximately  207c  On  the  other  hand  the  N  =  16 

lv*! 

SPLINE  estimate  has  relative  error  of  less  than  1%. 

Figures  01.1.1-10.1.4  compare  the  data  fits  for  N  =  2.  The 
start-ups  (ITR  =  0)  are  shown  as  well  as  the  converged  fits 
(ITR  =  10  for  AVE  and  ITR  =  14  for  SPLINE).  Figures  01.1.5-01.1.6 
show  the  converged  data  fits  for  N  =  16.  Note  that  in  this 
case  both  AVE  and  SPLINE  converged  after  4  iterations  of  the  MLE 
algorithm.  However,  the  SPLINE  procedure  provided  a  near  perfect 
data  fit. 

This  example  is  typical  of  most  of  the  vector  systems  that 
were  studied.  Generally  speaking,  the  SPLINE  algorithm  produced 
better  parameter  estimates  and  data  fits. 


AVE 

N 

0) 

aN 

a0 

aN 

al 

leN! 

2 

6.3864 

-12.8383 

4.2478 

20.4769 

4 

5.7480 

-  5.4170 

7.3614 

9.8076 

8 

5.6564 

-  1.8301 

9.7648 

5.4385 

16 

5.7873 

3.6873 

6.6713 

3.7287 

Y*  = 

6.0000 

2.5000 

9.0000 

TABLE  01.1.1 


SPLINE 


1  z 

0) 

-N 

fo 

fl 

|6nI 

2 

6.1102 

-5.7950 

10.3718 

9.777 

4 

6.4861 

5.6291 

13.2680 

7.8832 

8 

6.0432 

2.8791 

9.2921 

.7144 

16 

6.0079 

2.5761 

9.0591 

.1431 

6.0000 


2.5000 


9.0000 


1 


0 1  .  1 N2AV 


FIGURE  01.1.2 


01 . 1N2SP 


FIGURE  01.1.3 


*  O  CM  O 


I 


-r  r 


1  1“ 


x(t)  +  x  x(c)  +  aQx(t-l)  +  a^x(t-l)  =  u^t) 


+  +  +  data 


x*  *  6.0 

16,4  , 

.i'  =  5 . 


•S  -  2*5 


a*  =  9.0 


AVE  Model  x16,4=  5.7873  a*6,4  =  3.6873  a*6,4  =  6.6713 


- { - f- 

i  0.40 


I 

0.80  1.?0 

T  !  M ! 


l .  on 


FIGURE  01.1.5 


EXAMPLE  01.2 


In  this  example  we  identify  only  the  time  delay  r.  The  system 
is  assumed  to  be  governed  by  the  model 

x(t)  +  36x(t)  +  2.5  x(t-r)  +  9x(t-r)  =  u  ^(t)  > 

with  initial  data 

x0(s)  =  1  ,  x0(S)  =  0  ,  -r  s  S  £  0  , 

and  scalar  output 


y (t)  =  x(t)  , 

where  r  is  the  unknown  delay. 

This  example  proved  to  be  very  interesting.  The  start-up 
r*  =  1.0  was  taken  to  be 

rN’°=  1.2  . 

At  N  =  2,  the  AVE  procedure  did  not  converge  (in  fact  estimates 

for  r^  were  growing  without  bound),  while  the  SPLINE  algorithm 

^  2 

converged  to  the  estimate  r  =  2.3476.  At  N  =  4,  SPLINE  produced 
A  ^ 

the  estimate  r  =  .9830.  However,  for  N  =  4,  AVE  converged  to  the 
~4 

estimate  of  r  =  4.8694.  For  higher  N,  the  SPLINE  procedure  pro¬ 
duced  better  and  better  estimates.  At  N  =  8  the  AVE  scheme  pro¬ 


duced  a  sequence  of  MLE  estimates  that  oscillated  between  the  values 
.7000  and  1.3000.  More  precisely,  the  MLE  iterations  continued  to 
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produce  sequences  similiar  to 

....7113,1.0477,1.2755,  •••  ,.7082,1.0396,1.2811...  . 

Consequently,  the  N  =  8  AVE  scheme  never  "converged"!  At  N  =  16, 
both  AVE  and  SPLINE  converged  to  reasonable  estimates  of  the 
parameter  r. 

N,0 

This  example  was  repeated  using  a  start-up  value  of  r  =  .8 
and  the  results  were  exactly  the  same.  Table  01.2.1  contains  a 
summary  of  the  convergence  for  this  example.  Figures  01.2.1-01.2.4 
illustrate  the  start-ups  and  converged  data  fits  at  N  =  16  for  AVE 
and  SPLINE. 


AVE 

SPLINE 

.sN  ,  , 

: 

~N 

N 

r  leNi 

N 

r 

!  cn  1 

2 

did  not  converge 

2 

2.3476 

3.3476 

4 

-4.8694  5.8694 

4 

.9830 

.0170 

8 

did  not  converge 

8 

.9939 

.0061 

16 

.9274  .0726 

16 

.9987 

.0013 

r*  = 

1 . 0000 

r*  55 

1.0000 

TABLE  01.2.1 


FIGURE  01.2.3 
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ID  MODEL  02 


This  model  is  the  oscillator  governed  by  the  equation 
'x(t)  +  16x(t)  +  lOx(t-l)  -  lOx(t-l)  =  u  ^(t)  , 

with  initial  data 

x0(s)  =  1  ,  xQ(s)  =  0  ,  -1  s  s  S  0  , 

and  scalar  output 


y(t)  «  x ( t )  . 

As  before,  data  was  generated  at  101  equally  spaced  points  by 
solving  the  system  analytically  and  evaluating  the  solution.  This 
data  was  used  in  the  following  examples;  02.1-02.2. 
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EXAMPLE  02.1 

Here  we  identify  all  three  of  the  equation  coefficients.  The 
model  is  described  by 

x(t)  +  uj2x(t)  +  aQx(t-l)  +  a^x(t-l)  =  u  1<t) 
with  initial  data 


xQ(s)  =  1  ,  xQ(s)  =  0  ,  -1  s  s  6  0  , 

and  output 


y (t)  =  x ( t )  . 


We  seek  to  estimate  the  true  parameters  id*  =  4.0,  a*  =  10.0  and 
a*  =  -10.0.  Start-up  values  for  these  parameters  were  selected  to 
be 


juN,°  =  /20  , 


2-°  =  0.0 


a*’°  =  -9.0 


Runs  were  made  for  N  =  2,  4,  8  and  16.  The  results  for  AVE  and 
SPLINE  are  summarized  in  Tables  02.1.1  and  02.1.2,  respectively. 
Again,  the  error  |e  j  is  taken  to  be  in  the  norm,  and  the 
relative  £  error  at  N  =  16  is  about  3%  for  AVE  and  less  than  17. 
for  SPLINE. 

Figures  02.1.1  -  02.1.2  show  the  N  =  16  AVE  data  fits  for  the 
start-ups  and  converged  values  of  the  parameters.  Figures  02.1.3" 
02.1.4  show  the  N  =  16  SPLINE  data  fits  for  the  start-ups  and 


[il«] 


converged  values  of  the  parameters.  The  SPLINE  procedure  clearly 
does  better. 

In  this  example  (as  well  as  others)  we  checked  the  CPU  times 
required  for  each  run.  'Rie  two  schemes  AVE  and  SPLINE  basically 
require  the  same  amount  of  computer  time  for  each  iteration  of  the 
MLE  algorithm.  For  example,  at  N  =  16,  the  AVE  scheme  used  approx 
imately  17.75  sec/ITR  while  the  SPLINE  scheme  used  approximately 
18-40  sec/ITR.  Such  figures  are  typical  of  all  the  runs. 


-  —  - ■  1  — — ■  - - -  •  -  --  -  — -  -  ■  — - - — - 

AVE 

N 

-sN 

aN 

1  ~  1 

(0 

ao 

al 

2 

did 

not 

converge 

4 

d  i  d 

not 

conve  rge 

8 

3.4386 

12.3634 

-6.6389 

.7128 

16 

3.9826 

10.4641 

-9.7997 

.6818 

V*  = 

4.0000 

10.0000 

-10.0000 

TABLE  02.1.1 


SPLINE 


/vN 

-N 

0) 

fo 

1  nI 

3.8092 

9.0371 

-9.3642 

1.7895 

3.9751 

9.9323 

-9.9241 

.1685 

3.9963 

9.9511 

-9.9978 

.0548 

3.9943 

9.9920 

-9.9812 

.0325 

4.0000 

10.0000 

-10.0000 

TABLE  02.1.2 


s 


FIGURE  02.1.1 


0  2  .  1  N  1  6  S 


on  0.4  0  0.80 

T  [  w  r- 

■  I.;1 


FIGURE  02.1.3 


EXAMPLE  02.2 


In  Chis  problem  we  seek  to  estimate  the  coefficients  of  the 
delayed  terms  and  the  time  delay  itself.  In  particular,  we  assume 
that  the  system  is  governed  by  the  model 

x(t)  +  16x(t)  +  aQx(t-r)  +  a^xCt-r)  =  u  ^(t)  , 
with  initial  data 


xQ(s)  =  1  ,  xQ( s)  s  0  ,  -r  s  s  S  0 

and  output 


y (t)  -  x ( t )  , 


and  the  true  parameters  to  be  estimated  are  a^  =  10.0,  a*  =  -10.0 
and  r*  =  1.0.  Start-up  values  for  each  run  were 


11.0 


N,  0 
31 


-9.0 


N,0 

r 


1.2  . 


Convergence  results  for  this  example  are  summarized  in  Tables  02.2.1 
and  02.2.2.  At  N  =  16  the  relative  error  for  AVE  is  approximately 
3.57o,  while  the  N  =  16  SPLINE  scheme  produced  a  relative  error 
of  less  than  1%. 

Figures  02.2.1  and  02.2.2  show  the  N  =  4  converged  data  fits 
for  AVE  and  SPLINE,  respectively.  For  N  i  8,  the  data  fits  are 
nearly  perfect  and  are  not  shown. 
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AVE 

N 

ao 

,JN  /.N 

al 

leNl 

2 

did 

not  converge 

4 

54.5124 

-9.1876  2.4190 

46.7439 

8 

19.4941 

-9.4927  1.3506 

10.3520 

16 

10.6433 

-9.9089  .9998 

.7346 

Y*  = 

10.0000 

-10.0000  1.0000 

TABLE  02.2.1 


SPLINE 

N 

/.N 

ao 

a 

r 

leN> 

2 

9.2585 

-10.5360 

1.0908 

1.3683 

4 

10.0927 

-10.0619 

1.0076 

.1622 

8 

9.9724 

-10.0177 

1.0010 

.0463 

16 

9.9811 

-10.0108 

1.0017 

.0314 

Y*  = 

10.0000 

-10.0000 

1.0000 

TABLE  02.2.2 
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V. 


U.  MODEL  03 


This  model  is  also  a  harmonic  oscillator;  however  we  shall 
both  position  and  velocity  as  output  data.  In  particular,  the 
model  is  governed  by  the  equation 

x(t)  +  4x(t)  +  x(t-l)  -  x(t-l)  =  u  ^(t)  . 

or  in  equivalent  vector  form, 

P 


d 

dt 


xL(t) 


L*2(t) 


0  1 


-4  0 


xL(t) 


[_x2(t)_ 


0  0 


l*  -y 


x^t-l) 


‘ol 


:  +  i 


1  ! 

U  (t-r- J  LiJ 


u_i(t.)  , 


with  initial  data 


n  x  (s’) 

!  i 

1 

_ I 

(s) 

X0(s) 

1  0 

L  2  J 

1 

J 

o 

,  -1  s  s  s  0  , 


and  vector  output 


r  yi(t)- 


y(t; 


L 


y2(t) 


l  o 


o  i 


(t) 


x?(t) 


1 


use 


This  system  was  solved  analytically  to  obtain  data  at  101  equally 
spaced  points  tor  Examples  03.1-03.4. 
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EXAMPLE  03.1 

For  this  problem  we  seek  to  estimate  two  of  the  systems  co¬ 
efficients.  In  particular,  the  model  is  assumed  to  be  governed 
by  the  equation 

x(t)  +  4x(t)  +  aQx(t-l)  +  a^x  (t- 1 )  =  u  ^(t) 
with  initial  data 


xQ(s)  =  1  ,  xQ(s)  =  0  ,  -1  s  s  i  0  , 


and  vector  output  (both  position  and  velocity) 


"y1(t)” 

“  x(t) 

y2(t> 

x(t) 

y(t)  = 


The  true  parameters  a*  =  1.0  and  a*  -  -1.0  were  estimated  using 
start-up  values  of 


Runs  with  N  =  2,  4,  8  and  16  were  made  and  the  convergence 
results  are  summarized  in  Tables  03.1.1  -  03.1.2.  Note  that  at 
N  =  16,  the  AVE  scheme  produced  parameter  estimatt  <  considerably 
worse  (about  16%  "relative  error")  than  the  N  =  8  estimate 
(about  7%  error).  The  N  =  16  SPLINE  procedure  gave  estimates  with 
less  than  TU  relative  error. 
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Typical  data  fits  are  illustrated  in  Figures  03 . 1 . I  -  03 . I .8 . 
Figures  03.1.1  -  03.1.2  are  the  N  =  8  AVE  start-up  data  fits  for 
the  position  (Y(l))  and  velocity  (Y(2)),  respectively.  The  con¬ 
verged  N  =  8  AVE  data  fits  are  shown  in  Figures  03.1.2  -  03.1.4. 
Figures  03.1.5  -  03.1.8  show  the  same  data  fits  for  the  N  =  8 
SPLINE  procedure. 


AVE 

N 

~N 

ao 

al 

leNl 

2 

1.1437 

-  .8789 

.2648 

4 

1.1504 

-  .9221 

.2283 

8 

1.0951 

-  .9579 

.1372 

16 

.7215 

-1.0483 

.3261 

Y*  = 

1.0000 

-1.0000 

TABLE  03.1.1 
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SPLINE 

N 

i? 

I  e  j 

- 

0 

_1 

1  u  1 

2 

1.2474 

-1.0991 

.^65 

4 

1.0256 

-1.0350 

.0606 

8 

.9936 

-1.0137 

.0398 

16 

.9739 

-1.0100 

.0361 

II 

* 

>• 

1.0000 

-1.0000 

TABLE  03.1.2 
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EXAMPLE  03.2 


In  this  example  we  attempt  to  estimate  all  of  the  system  co¬ 
efficients.  Consequently,  the  model  is  assumed  to  be  of  the  form 

2 

x(t)  +  a>  x(t)  +  aQx(t-l)  +  a^x(t-l)  =  u  ^(t) 
with  initial  data 


xQ(s)  =  1  ,  xQ(s)  =  0 


and  output 


y(t) 


x(t) 


L*(t)J 

The  true  parameters  uj*  =  2.0,  a*  =  1.0,  a* 
using  start-up  values  of 


-1.0  were  estimated 


N,0 

a 


=  /3. 


N,  0 
a0 


-.73  . 


This  example  is  again  typical  in  that  the  SPLINE  scheme  pro¬ 
duced  better  estimates  than  the  AVE  scheme  (although  the  N  =  2 
SPLINE  run  did  not  converge).  The  convergence  of  the  parameter 
estimates  is  summarized  in  Tables  03.2.1-03.2.2.  The  N  -  16 
results  show  that  the  relative  error  is  about  57„  for  AVE  and  1.1 
for  SPLINE.  The  data  fits  for  N  =  8  and  16  were  nearly  perfect 
fits  for  both  AVE  and  SPLINE.  Consequently,  no  plots  are  given. 
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AVE 

N 

aN 

X 

~N 

ao 

-N 

al 

I6nI 

2 

1.2398 

3.8802 

1.3463 

5.9867 

4 

1.7711 

2.1018 

-  .2201 

2.1106 

8 

1.8955 

1.5372 

-  .6522 

.9895 

16 

1 . 9404 

.9505 

-  .9033 

.2050 

y*  = 

2.0000 

1.0000 

-1.0000 

TABLE  03.2.1 


SPLINE  J 

N 

a; 

~N 

!£L 

not 

-N 

31 

le  I 
n' 

2 

did 

converge 

4 

2.0320 

•  9324 

-1.1136 

.2132 

8 

1.9995 

•  9956 

-1.0124 

.0173 

16 

1.9903 

1.0149 

-.9840 

.0406 

Y* 

2 . 0000 

1.0000 

1.0000 

TABLE  03.2.2 


-92- 


LXAMPUE  03.4 


For  this  example  we  seek  to  estimate  an  initial  function, 
two  system  coefficients  and  the  time  delay.  In  particular  we 
assume  that  the  initial  position  is  a  constant  but  unknown  value 
and  hence  the  model  takes  the  form 


x(t)  +  4x(t)  +  aQX(t-r)  4-  a^x(t-r)  =  u  ^(t) 


with  (partially  unknown)  initial  data 


xQ(s)  =.  C  ,  xQ(s)  =  0  ,  -r  <,  s  s  0 


and  vector  output 


y(t)  * 


x(t) 


x(t) 


J 


The  parameters  C*  =  1.0,  a*  “  1.0,  a*  ~  -1.0  and  r* 
estimated  Uoing  start-up  values 


1.0  were 


CN’°=  0.0,  a*’°  =  .9,  a?’0 


N ,  0 

-.9,  r  =  .9 


For  each  N  =  2,  4,  8  and  16,  the  AVE  scheme  did  not  converge. 
At  N  =  2  the  SPLINE  scheme  did  not  converge;  however,  at  N  -•  4,  8 
and  16  the  SPLINE  procedure  converged  to  good  estimates  ot  the 
parameters.  This  example  was  also  run  with  other  stnrt-ups  and 
it  was  observed  that  unless  the  start-ups  were  reasonably  close 
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(i.e.  as  above)  the  SPLINE  scheme  also  diverged.  The  parameter 
estimates  produced  by  the  SPLINE  scheme  are  listed  in  Table 
03.4.1.  The  error  ]eN|  listed  in  this  table  is  the  error" 


Observe  that  the  relative  error  at  each  N  =  4,  8,  16  is  between  1 
and  2  percent. 

Figures  03-4.1-03.4.2  show  the  N  *  4  SPLINE  data  fits.  Note 
that  the  MLE  required  29  iterations  to  converge. 


J 


\ 


SPLINE  j 

~N 

-N 

-N 

N 

C 

r 

a0 

al 

leul 

2 

did 

not 

converge 

— 

4 

.9960 

.9440 

1.0135 

-1.0085 

.0820 

8 

.9998 

.9999 

.9937 

-1.0137 

.0203 

16 

1.0011 

1.0156 

.9874 

-1.0131 

.0434 

Y*  * 

1.0000 

1.0000 

1.0000 

-1.0000 

TABLE  03.4.1 


-94- 


T  I  M  F 


FIGURE  03.4.1 


0  3  .  Li  N  '4  S  P 


n - -  r 


x(t)  +  4x(t)  +  an*(t-r)  +  a.x(t-r)  =  u  .  (t) 


xQ(s)  s  C  ,  Xq(s)  =  0 


■  +  +  data  C*  =  1.0  r*  »  1.0  a*  =  1.0  a*  *  -1.0 

4  29  4  29  4  29  4  29 

- SPLINE  Model  CT’  =.9960  r  ’  =.9440  a^’  =1.0135  a*’  =-1.0085 


-j - - - 1 - 


I  -  -l  - 


0.40 


0.  80 


1  .  ?0 


T  IMf 


FIGURE  03.4.2 


/ 


-96- 

ID  MODEL  04 

This  model  is  the  oscillator  considered  in  ID  MODEL  03,  with 
noise  added  to  the  output.  In  particular,  the  system  is  governed 
by  the  equation 

x(t)  +  4x(t)  +  x(t-l)  -  x(t-l)  =  u  ^(t)  , 
with  initial  data 

xQ(s)  =  1  ,  xQ(s)  =0  ,  -1  s  s  £  0  , 

and  (noisy)  output 


x(t) 

vx(t) 

y(t)  = 

+ 

X(t) 

1 

U 

where  v^(t)  (i=l,2)  is  a  computer  simulated  normal  random  var¬ 
iable  with  zero  mean  and  standard  deviations  of  0.1  on  the  position 
data  ( v^)  and  0.2  on  the  velocity  data  (v^). 

The  random  variables  v^(t)  (i  =  1,2)  were  generated  using 
routine  GGNQF  of  the  IMSL  library  (see  IMSL  Users  Guide)  and 
added  to  the  analytic  solution  x(t)  and  x(t)  of  the  delay  equation 
to  produce  data  (y  ,i »  1,2,»  •• ,  101)  at  101  equally  spaced  times 
on  [0,2].  These  values  produced  rather  noisy  data,  which  was  used 
in  following  examples;  04.2  -  04.3. 


EXAMPLE  04.2 


For  this  example  we  estimate  two  system  coefficients  and  the 
time  delay.  The  model  is  assumed  to  have  the  form 

'x(t)  +  4x(t)  +  aQx(t-r)  +  a^x(t-r)  =  u  ^(t)  , 

with  initial  data 


xQ(s)  =  1  ,  xQ(s)  =  0  ,  -r  s  s  s  0  , 


and  output 


y(t)  = 


x(t) 

x(t) 


For  N  =  2,  4,  8  and  16  the  approximating  identification  problem 
was  formulated  and  a  version  of  the  MLE  algorithm  described  in 
[9]  was  used  to  estimate  the  parameters  a*  =  1*0,  a*  =  -1.0  and 
r*  =  1.0.  Start-up  values  for  each  run  were  set  at 


a 


N  ,0 
0 


.75 


N,  0 


=  -.75 


N,0 


.8  . 


Except  for  the  N  =  2  AVE  run,  each  run  converged  to  reasonable 
estimates  for  the  parameters.  Again  the  SPLINE  scheme  produced 
better  results.  The  N  *  16  AVE  estimates  give  about  147,  relative 
error,  while  the  N  =  16  SPLINE  estimates  have  about  17,  relative 
error.  The  convergence  results  for  this  problem  are  summarized 
in  Tab le  s  04.2.1  and  04.2.2. 
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Typical  data  fits  for  this  problem  are  illustrated  in  Figures 
04.2.1  -  04.2.4.  Note  that  the  data  produced  by  adding  the  simulated 
noise  is  indeed  very  "noisy".  However,  at  N  *  8  both  AVE  and  SPLINE 
do  a  "good"  job  of  fitting  the  data.  In  fact,  the  N  =  8  converged 


data  fits  provide  nearly  perfect  matches  to  the  system  outputs  with¬ 
out  the  noise. 


AVE 

N 

-N 

~N 

.N 

1  1 

ao 

*1 

r 

IN' 

"ir 

2 

773.3040 

-.9699 

65.6704 

837.0045 

4 

2.2051 

-.9832 

1.8078 

2.0297 

8 

1.3959 

-.9947 

1.2547 

.6559 

16 

.7740 

-1.0664 

1.1142 

.4066 

Y*  * 

1.0000 

-1.0000 

1.0000 

TABLE  04.2.1 


SPLINE 

N 

-N 

ao 

~N 

31 

-N 

r 

le»l 

2 

1.0813 

-1.0254 

.8233 

.2834 

4 

1.0001 

-1.0283 

.9533 

.0751 

8 

.9881 

-1.0195 

.9937 

•  0377 

16 

.9850 

-1.0156 

1.0013 

.0319 

V*  = 

1.0000 

-1.0000 

1.0000 

TABLE  04.2.2 
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EXAMPLE  04.3 


In  this  problem  all  of  the  system  coefficients  and  the  time 
delay  are  estimated.  In  particular  the  model  is  assumed  to  have 
the  form 

2 

x(t)  +  0)  x (t)  +  aQx(t-r)  +  a^xCt-r)  =  u  ^t)  , 

with  initial  data 


xQ(s)  h  1  ,  xQ(s)  =  0  ,  -r  s  s  £  0  , 


and  vector  output 


y(t)  - 


x(t) 


x(t) 


Start-ups  for  the  true  parameter  u>*  =  2.0, 
r*  *  1.0  were  set  at 


a* 

0 


1.0,  a*  *  -1.0, 


a»-°-.75 


N,  0 


-.75 


N,0 


.8 


and  runs  were  made  for  N  =  2,  4,  8  and  16. 

For  N  =  2  neither  AVE  nor  SPLINE  converged.  At  N  *  4  the  AVE 
scheme  converged.  However,  the  N  =  4  MI£  procedure  for  the  SPLINE 
approximation  never  really  converged.  The  M1E  algorithm  produced  a 
sequence  of  parameters  that  oscillated  between  two  values.  These 
two  values  are  displayed  in  Table  04.3.2.  Observe  that  either  of 


ffi 


the  two  parameter  estimates  obtained  by  the  SPLINE  scheme  is 
better  than  the  AVE  estimate •  At  N  =  8  both  AVE  and  SPLINE  con¬ 
verged,  while  at  N  =  16  the  SPLINE  procedure  again  produced  two 
values  for  each  parameter  and  the  MLE  algorithm  oscillated  between 
these  values. 

The  data  fits  for  this  example  are  typical  of  the  previous 
examples.  Figures  04.3.1  -04.3.4  illustrates  the  N  =  8  converged 
data  fits.  The  data  fits  at  N  =  16  for  AVE  and  SPLINE  are  almost 
the  same,  and  for  the  SPLINE  scheme  either  of  the  two  parameters 
given  in  Table  04.3.2  produces  essentially  the  same  data  fits. 


did  not  converge 


1.6475 

-2.2109 

.1635 

.8603 

4.7269 

1.8221 

1.6184 

-.4164 

.8807 

1.3799 

1.7647 

1.2959 

-.3349 

.7405 

1.1963 

2.0000 

1.0000 

-1.0000 

1.0000 

TABLE  04.3.1 


SPLINE 


aN 

*  N 

/.N 

a' 

a0 

ai 

r 

leN* 

did 

not 

converge 

2.1246 

.6354 

-1.4428 

1.4526 

1.3846 

2.1191 

.6633 

-1.4263 

1.4161 

1.2982 

1.9671 

1.0641 

-  .9164 

.9381 

.2425 

1.9436 

1.1155 

-  .8410 

.9074 

.4235 

1.9736 

1.0529 

-  .9373 

.9573 

.1847 

2.0000 

1.0000 

-1.0000 

1.0000 

TABLE  04.3.2 
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This  model  is  the  second  order  oscillator  considered  in  ID 
MODEL  01,  with  vector  output.  However,  data  was  generated  on  a 
longer  time  interval  by  numerically  integrating  the  equations.  In 
particular,  the  system  is  governed  by  the  delay  equation 

x(t)  +  36x(t)  +  2.5x(t-l)  +  9x(t-l)  =  u  ^(t)  , 

with  initial  data 


xQ(s)  =  1  ,  xQ(s)  =0  ,  -1  S  s  £  0  , 


and  vector  output 


y(t)  - 


This  system  was  numerically  integrated  (using  a  modified  4th  order 
scheme)  to  obtain  the  solution  on  the  interval  [0,5] .  Data  was 
generated  at  101  equally  spaced  points  (i.e.  20  data  points  per 
unit  Interval)  using  this  numerical  solution. 

As  a  rough  check  of  the  numerically  produced  data,  the 
numerical  solution  and  the  analytic  solution  were  compared  on  the 
interval  [0,2].  The  numerical  solution  agreed  exactly  (i.e.  to 
eight  decimal  places)  with  the  analytic  solution,  giving  some  in¬ 
dication  that  the  data  for  this  model  is  reasonably  good. 
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As  a  final  cocmenC,  we  mention  that  the  numerical  algorithm 
used  to  integrate  the  delay  equation  is  completely  unrelated  to 
any  of  the  approximation  schemes  used  in  the  identification 
algorithms.  Consequently,  we  are  not  using  data  generated  by  the 
algorithm  that  we  are  attempting  to  study. 


EXAMPLE  05.  L 


For  this  example  we  seek  to  estimate  the  time  delay  and  two 
system  coefficients.  The  model  is  assumed  to  be  of  the  form 

x  ( t )  +  36x(t)  +  aQx(t-r)  +  ajX(t-r)  =  u  ^(t)  , 

with  initial  data 

xQ(s)  i  1  ,  xQ(s)  so  ,  -r  *  s  i  0  , 

and  vector  output 


y(t) 


x(t) 

x(t) 


Recall  that  in  this  example  we  have  data  generated  for  5  seconds, 
i.e.  on  the  interval  [0,5],  at  101  points.  The  parameters  to  be 
estimated  are  r*  =  1.0,  a*  =  2.5  and  a*  =  9.0.  Start-up  values 
for  each  run  were 


r 


N,0 


2.2 


9.5  . 


Other  start-up  values  were  attempted  and  the  algorithms  were  found 
to  diverge  if  the  start-up  errors  were  too  large  and  in  some  cases 
the  algorithms  converged  to  parameters  different  than  r*,  ag,  a*. 
This  again  shows  that  there  can  be  a  lack  of  global  identif iabllity 
Runs  for  N  =  2,  4,  8  and  lb  were  made  for  both  AVE  and  SPLINE. 


i 


For  low  N,  the  AVE  scheme  did  not  converge.  However,  both  AVE  and 
SPLINE  converged  for  larger  N  and  produced  reasonable  estimates  of 
the  parameters.  These  results  are  summarized  in  Tables  05.1.1  and 
05.1.2.  Observe  that  at  N  =  16  the  SPLINE  procedure  produced 
estimates  with  approximately  27.  relative  error,  while  the  N  =  16 
AVE  estimates  have  relative  error  greater  than  22%. 

The  data  fits  for  this  example  are  very  interesting.  This 
example  is  very  dynamic  and  oscillatory  on  the  interval  [0,5]. 
However,  at  N  *  16  both  AVE  and  SPLINE  produce  fairly  good  data 
fits,  with  the  SPLINE  scheme  matching  the  data  better  than  AVE. 
Figures  05.1.1  -  05.1.4  show  the  iteration  0  and  converged  data 
fits  for  the  AVE  scheme.  Figures  05.1.5  -  05.1.8  illustrate  the 
same  thing  for  the  SPLINE  procedure. 
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"N 

~N  -N 

N 
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fo  fl 

I£n' 

2 

did 

not  converge 

— 

4 

d  i  d 

not  converge 

— 

8 

.2492 

2.8002  -  3.8982 

13.9492 

16 

.9106 

1.7439  10.9570 

2.8025 

\*  “ 

1.0000 

2.5000  9.0000 

. 

TABLE  05.1.1 
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SPLINE 

N 

N 

*  N 

/.N 

i  i 

r 

!o 

a_L 

leNl 

2 

did 

not  conve 

r  g  e 

4 

.6812 

-2.3261 

11.7017 

7.8466 

8 

.9985 

2.9163 

8.9459 

.4719 

16 

1.0000 

2.6016 

9.0872 

.1888 

.  *  = 

Y 

1.0000 

2 . 5000 

9.0000 

TABLE  05.1.2 
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I 


TIME 


FIGURE  05.1.5 
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ID  MODEL  K1 

This  is  a  model  with  continuous  kernel.  The  system  is  governed 
by  the  equation 

x(t)  =  -3x(t-l)  -  x(t+s)ds  +  u  ^(t) 


with  initial  data 


xQ(s)  si,  -1  s  s  s  0  , 

and  output 

y (t)  =  x(t)  . 

This  equation  can  be  transformed  to  a  system  of  two  equations  with 
no  integral  term  (see  pages  63-64  of  [ 9  ])  and  solved  using  the 
method  of  steps.  The  analytic  solution  was  obtained  by  this  pro¬ 
cedure  and  data  was  generated  at  101  equally  spaced  points  on  [0,2]. 
This  data  was  used  in  the  following  examples;  Kl.l,  Kl.4. 


/ 
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EXAMPLE  Kl.l 

In  this  example  we  attempt  to  identify  the  kernel  by  assuming 
that  it  is  constant  function  with  unknown  value.  Therefore,  the 
model  is  of  the  form 

x(t)  =  -3x(t-l)  +  k  x(t+s)  ds  +  u  ^  (t)  , 

with  initial  data 


xQ(t)  si  ,  -1  <  s  £  0  , 


and  output 


y (t)  *  x(t)  . 


The  constant  k*  =  -1,0  is  to  be  estimated.  Runs  at  N  *  2,4,8,16 
were  made  with  the  start-up  of 


This  example  is  interesting  for  several  reasons.  It  is  an 
example  that  contains  a  distributed  delay  and  it  is  the  only 
example  we  have  run  where  the  AVE  scheme  produced  better  parameter 
estimates  than  the  SPLINE  scheme.  Table  Kl.1.1  illustrates  the 
convergence  of  the  parameter  estimates  for  AVE  and  SPLINE.  Figures 
Kl.1.1  and  Kl.1.2  compare  the  N  =  8  converged  data  fits  for  AVE  and 
SPLINE,  respectively.  Observe  that  even  though  the  N  ■  8  AVE  scheme 
produced  a  better  parameter  estimate,  the  N  ■  8  SPLINE  scheme  does  a 


much  better  job  of  fitting  the  data. 


AVE 

SPLINE 

N 

kN 

!•*! 

N 

S5 
<  X 

leNl 

2 

-1.2953 

.2953 

2 

-1.2679 

.2679 

4 

-1.0765 

.0765 

4 

-1.0827 

.0827 

8 

-1.0156 

.0156 

8 

-1.0301 

.0301 

16 

-1.0058 

.0058 

16 

-1.0177 

.0177 

k* 

=  -1.0000 

k* 

=  -1.0000 

TABLE  Kl.1.1 


1 


N8SP 


T  1  MF 


FIGURE  Kl.1.2 


EXAMPLE  Kl  4 


In  this  example  we  estimate  two  system  coefficients  and  the 
time  delay.  As  before,  the  kernel  is  estimated  by  assuming  that 
it  is  an  unknown  but  constant  function.  Therefore,  the  model  is 
assumed  to  be  of  the  form 

x(t)  =  a^x(t-r)  +  k  x(t-t-s)  ds  +  u  ^(t)  , 

-r 

with  initial  data 


and  output 


Xq(s)  =  1  ,  -r  £  s  £  0 


y(t)  =  x(t)  . 


The  true  parameters  a^  =  -3.0,  k*  *  -1.0  and  r*  =  1.0  we  estimated 
using  start-ups  of 


1.5  . 


Runs  were  made  for  N  =  2,4,8  and  16.  The  AVE  scheme  did  not  con¬ 
verge  for  N  =  2  and  4.  However,  for  N  =  8  and  16  the  AVE  scheme 
converged  but  produced  rather  poor  parameter  estimates.  The  SPLINE 
scheme  converged  for  each  N  a  2,4,8,16  and  for  N  s  4  produced  good 
parameter  estimates.  The  numerical  results  for  this  problem  arc 
summarized  in  Tables  Kl.4.1  and  Kl.4.2. 


Figures  Kl.4.1-  Kl.4.4  compare  the  N  =  8  AVE  and  SPLINE  data 


i 

l 


> 
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fits.  In  particular. 

Figures  Kl.4.1  and  Kl.4. 2  show 

the  N  =  8  AVE 

start-up 

and  converged  data  fits,  respectively.  Figures  Kl.4. 3 

and  Kl.4. 

4  show  the  same  thing  for  the 

SPLINE  procedure . 

AVE 

-'N 

aN 

N 

r 

k 

fl 

'eN> 

2 

did  not 

converge 

4 

did  not 

converge 

8 

.8802 

.2182 

-4.1641 

2.0657 

16 

.9383 

-.3806 

-3.5533 

1.2346 

Y* 

=  1.0000 

-1.0000 

-3.0000 

TABLE  Kl.4.1 

SPLINE 

N 

AN 

r 

kN 

al 

|eN| 

2 

.9100 

-  .4376 

-3.4478 

1.1002 

4 

.9896 

-1.0087 

-3.0580 

.0771 

8 

1.0018 

-1.0390 

-2.9953 

.0455 

16 

1.0042 

-1.0410 

-2.9841 

.0611 

Y* 

=  1 . 0000 

-1.0001 

-3.0000 

TABLE  Kl.4.1 


T  (1) 


Till 


□ 

r~ 


p 


.  - —  f " 


i 


x(t)  =  a^x(t-r)  +  k  J°  x(t+s)  ds  +  u  1 (t) 

-r 

+  +  +  data  a^  *  -3.0  r*  =  1 

-  SPLINE  Model  a®’6  =  -2.9953  r8,6  =* 


I - 1 - \ - -j - 4 - f~ 

0.40  0.80  1.20 

TIME 


FIGURE  Kl.4.4 
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Summary  Remarks 

The  major  lesson  of  our  experience  with  the  AVE  and  SPLINE 
identification  procedures  is  that  SPLINE  is  generally  superior  and 
commonly  displays  near  quadratic  convergence.  It  has  been  observed 

N 

that  the  error  function  E  can  have  multiple  relative  minima.  In 

order  to  solve  the  IDN  problem  we  have  used  a  maximum  likelihood 

estimator  (MLE),  which  in  the  case  of  a  scalar  measurement,  is 

equivalent  to  the  usual  quasi-linerization  (QL)  procedure  for 
N 

minimizing  E  .  Conditions  that  guarantee  convergence  of  the  QL 
procedure  are  rather  stringent  (see  [7])  and,  in  fact,  are  not 
satisfied  in  our  examples.  In  applications  it  would  seem  prudent 
to  employ  a  hybrid  algorithm  for  the  IDN  problem,  wherein  one 
would  initially  use  a  method  that  guarantees  descent  and  then 
employ  QL  only  in  the  neighborhood  of  a  minimizing  point. 


i 

I 


I 


-135- 


6 .  The  optimal  ccntrol  problem:  numerical  examples. 

In  this  section  we  present  numerical  results  for  a  number  of 
examples  of  the  optimal  control  problem  (OC) .  The  two  schemes 
AVE  and  SPLINE  were  employed  to  compute  approximating  optimal 
controls  u^  and  u^  for  several  values  of  N  chosen  to  illustrate 
convergence  properties.  The  linear  systems  examples  given  here 
are  essentially  the  same  as  some  of  the  examples  considered  in 
detail  in  [6 J.  For  these  examples  the  analytic  solution  u*  of  the 
optimal  control  problems  can  be  found  in  §3  of  that  report  and  we 
shall  not  redrive  those  solutions  here.  Only  one  (C8)  of  the 
linear  examples  presented  below  was  not  considered  specifically 
in  [6j»  however  for  the  particular  case  detailed  here  the  optimal 
control  can  be  computed  by  using  the  maximum  principle  for  delay 
systems  in  the  same  manner  as  was  done  for  Example  10  of  [  6  ]• 

Since  the  report  [ 6  ]  is  rather  complete  and  easily  obtained,  we 
shall  feel  free  to  use  the  results  presented  in  that  technical 
report  without  elaborate  comment  or  discussion.  For  the  motivation 
behind  our  choice  of  some  of  the  particular  examples  presented 
here  and  in  [  6  ],  the  interested  reader  can  consult  [  6  ]■ 

We  also  present  below  our  numerical  findings  for  two  nonlinear 
examples.  The  theory  for  use  of  the  AVE  approximations  with  a 
restricted  but  reasonable  class  of  nonlinear  system  optimal  control 
problems  is  developed  in  [1].  Consideration  of  the  arguments  given 
there  along  with  details  of  the  SPLINE  scheme  development  in  [  8  J 
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EXAMPLE  Cl 

The  first  system  is  given  by  the  scalar  enuation 
x(t)  =  x(t  -  1)  +  u(t),  0  <;  t  s  3 

with  initial  data 

x  (s )  si,  -1  £  s  £  0  , 


and  the  payoff  is  chosen  as 


J(u)  =  5[x(3)]2  +  %  [u(s)]2  ds 


The  optimal  control  u*  is  given  by  (see  page  11  in  [ 6  ] 


u*(t)  =  < 


6{-(t-2 r/2  -3/2},  0  S  t  S  1, 

6(t  -  3)  ,  1  S  t  S  2 

*6  ,  2  £  t  s  3, 


where  6  =  370/ [6(1  *-319/3)}  ^  .5745.  The  optimal  cost  is 
J*  =  J(u*)  is  1.7715  . 

Table  (Cl.l)  compares  J  and  J*  for  each  of  the  two  schemes 

AVE  and  SPLINE.  The  example  is  somewhat  typical  in  that  (as 
one  might  expect  from  theoretical  investigations  -  both  methods  are 

basically  first  order,  but  the  estimates  for  SPLINE  indicate  that 
one  should  expect  slightly  faster  convergence  for  this  scheme) 
SPLINE  converges  faster  than  AVE.  Note  that  the  error  for  SPLINE 
at  N  *  4  is  less  than  the  error  for  AVE  at  N  =  32. 


Table  (CL. 2)  contains  the  CPU  times  for  each  run  of  the 
conjugate -gradient  algorithm.  As  shown,  the  time  to  make  each  run 

is  very  reasonable  for  both  schemes,  although  SPLINE  requires 
slightly  more  time  per  run.  These  times  were  typical  for  all  the 

scalar  examples. 

-  N  »  N 

Tables  (Cl. 3)  and  (Cl. 4)  compare  the  controls  and  to  u* 
for  N  =  4,  8,  16,  32.  We  observe  that  SPLINE  provides  a  better 
approximation  to  u*  than  AVE.  It  is  interesting  to  note  that  SPLINE 
is  not  as  monotone  in  its  convergence  as  AVE. 
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I 

I 

I 

I 

I 


AVE 

SPLINE 

N 

JN 

N 

JN 

4 

1.72491 

.0466 

4 

1.77320 

.0017 

8 

1.74750 

.0240 

8 

1.77179 

.00029 

16 

1.75939 

.0121 

16 

1.77164 

.00014 

32 

1.76551 

.00599 

32 

1.77159 

.00009 

J*  = 

1.7715 

J* 

=  1.7715 

TABLE  Cl.l 


AVE 

SPLINE 

N 

CPU  Sec 

N 

CPU  Sec 

4 

23.8 

4 

30.6 

8 

28.9 

8 

39.1 

16 

39.1 

16 

59.5 

32 

56.1 

32 

93.5 

TABLE  Cl. 2 


I 
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time 

-  4 
u 

c> 

00 

0.00 

-2.0050 

-2.0067 

0.25 

-1.7340 

-1.7386 

0.50 

-1.4994 

-1.5069 

0.75 

-1.2962 

-1.3064 

1.00 

-1.1197 

-1.1317 

1.25 

-0.9662 

-  .9774 

1.50 

-  .8335 

-  .8397 

1.75 

-  .7214 

-  .7201 

2.00 

-  -6324 

-  .6272 

2.25 

-  .5708 

-  .5720 

2.50 

-  .5385 

-  .5527 

2.75 

-  .5291 

-  .5504 

3.00 

-  .5286 

-  .5504 

AVE 


- 16 
u 

-32 

u 

u* 

-2.0075 

-2.0086 

-2.0108 

-1.7400 

-1.7405 

-1.7450 

-1.5092 

-1.5092 

-1.5081 

-1.3112 

-1.3124 

-1.3106 

-1.1402 

-1.1448 

-1.1500 

-  .9877 

-  .9955 

-1.0054 

-  .8463 

-  .8527 

-  .8618 

-  .7170 

-  .7151 

-  .7181 

-  .6179 

-  .6082 

-  .5745 

-  .5708 

-  .5706 

-  .5745 

-  .5623 

-  .5683 

-  .5745 

-  .5621 

-  .5683 

-  .5745 

-  .5621 

-  .5683 

-  .5745 

TABLE  Cl. 3 
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SPLINE 

time 

u4 

-  8 
u 

-  16 
u 

-  32 
u 

u* 

0.0 

-2.0177 

-2.0109 

-2.0109 

-2.0109 

-2.0108 

0.25 

-1.7447 

-1.7439 

-1.7413 

-1.7416 

-1.7415 

0.50 

-1.5053 

-1.5070 

-1.5081 

-1.5084 

-1.5081 

0.75 

-1.3083 

-1.3094 

-1.3105 

-1.3106 

-1.3106 

1.00 

-1.1506 

-1.1501 

-1.1495 

-1.1491 

-1.1500 

1.25 

-1.0085 

-1.0027 

-1.0061 

-1.0054 

-1.0054 

1.50 

-  .8591 

-  .8648 

-  .8629 

-  .8615 

-  .8618 

1.75 

-  .7123 

-  .7147 

-  .7199 

-  .7178 

-  .7181 

2.00 

-  .6095 

-  .5928 

-  .5844 

-  .5805 

-  .5745 

2.25 

-  .5759 

-  .5746 

-  .5749 

-  .5746 

-  .5745 

2.50 

-  .5816 

-  .5750 

-  .5748 

-  .5746 

-  .5745 

2.75 

-  .5694 

-  .5774 

-  .5745 

-  .5746 

-  .5745 

3.00 

-  .5149 

-  .5418 

-  .5574 

-  .5658 

-  .5745 

TABLE  Cl. 4 
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EXAMPLE  C2 

In  this  control  problem,  which  is  the  same  rs  Example  3B  o t 
[6],  we  take  as  our  system  the  scalar  equation 

x(t)  =  ^  x(t-l)  +  u ( t )  ,  0  *  t  s  2 


with  initial  data 


x(s)  =  1  , 


-1  <;  s  ^  0 


The  payoff  is  given  by 

2 

J(u)  =  ^[x<2)]2  +  %  ^  [u(s)]2  ds 


The  optimal  control  is  given  by  (see  page  56  in  [  6]) 


u*(t)  2! 


&[  (rr/2)  (1-t)  +  1]  ,  0  i  t  s  1  , 


.  1  i  t  <  2  , 


where  6  2  -  .9967  (see  page  12  of  [  6 ])  and  the  optimal  cost  is 


J*  =  J(u*)  2.6787  . 

N 

Table  (C2.1)  summarizes  the  convergence  properties  of  J  to 

J*  and  compares  the  AVE  and  SPLINE  schemes.  Again  we  observe  an 

improvement  by  using  the  SPLINE  scheme.  Tables  (C2.2)  and  (C2.3) 

contain  the  control  values  for  AVE  and  SPLINE.  A  graphical 

comparison  of  u  ,  u  and  u*  is  presented  in  Figure  C2.1. 

Pi  s 


SPLINE 


N 

< 

I 

.  N 

ij  -j*i 

N 

JN 

4 

2.6765 

.0022 

4 

2.6827 

.0040 

8 

2.6891 

.0104 

8 

2.6801 

.0014 

16 

2.6894 

.0107 

16 

2.6792 

.0005 

32 

2.6864 

.0077 

32 

2.6790 

.0003 

J*  =  2.6787 

J*  =  2.6787 

TABLE  C2.1 


time 

*  4 
u 

.8 

u 

.16 

u 

.32 

u 

u* 

0.00 

-2.6371 

-2.6122 

-2.5962 

-2.5834 

-2.5623 

0.25 

-2.1679 

-2.1568 

-2.1583 

-2.1629 

-2.1709 

0.50 

--1.7783 

-1.7653 

-1.7645 

-1.7703 

-1.7795 

0.75 

-1.4593 

-1.4324 

-1.4086 

-1.3933 

-1.3881 

1.00 

-1.2112 

-1.1762 

-1.1363 

-1.1005 

-  .9967 

1.25 

-1.0410 

-1.0240 

-1.0069 

-  .9975 

-  .9967 

1.50 

-  .9521 

-  .9709 

-  .9837 

-  .9910 

-  .9967 

1.75 

-  .9263 

-  .9646 

-  .9831 

-  .9910 

-  .9967 

2.00 

-  .9248 

-  .9645 

-  .9831 

-  .9910 

-  .9967 

TABLE  C2.  2 
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SPLINE 


.4 

-  8 

.  16 

.32 

u* 

time 

u 

u 

u 

a 

0.00 

-2.5732 

-2.5679 

-2.5643 

-2.5626 

-2.5623 

0.25 

-2.1750 

-2.1652 

-2.1725 

-2.1708 

-2.1709 

0.50 

-1.7649 

-1.7858 

-1.7822 

-1.7789 

-1.7795 

0.75 

-1.3669 

-1.3778 

-1.3927 

-1.3871 

-1.3881 

1.00 

-1.0907 

-1.0465 

-1.0236 

-1.0129 

-  .9967 

1.25 

-  .9986 

-  .9966 

-  .9976 

-  .9968 

-  .9967 

1.50 

-1.0102 

-  .9987 

-  .9974 

-  .9968 

-  .9967 

1.75 

-  .9904 

-1.0028 

-  .9968 

-  .9968 

-  .9967 

2.00 

-  .8955 

-  .9409 

-  .9672 

-  .9815 

-  .9967 

TABLE  C2.3 
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EXAMPLE  C3 


by 


In  this  example  the  system  is  two  dimensional  and  is  described 


u(t)  , 


—  — 

— 

— 

_ 

~1 

—  «— 

—  — 

Xj^  (t) 

0 

1 

XjL(t> 

0  0 

Xj (t-1) 

0 

_d 

= 

+■ 

+ 

dt 

x2(t) 

0 

0 

x2(t) 

0  -1 

x2(t-l) 

1 

—  — 

— 

-  _ 

-  _ 

— 

0  £ 

t  £  2  and  the 

initial  data 

is 

chosen 

as 

x1(s) 


x2(s) 


10 


,  1  s  s  0. 


The  cost  functional  is  given  by 

2 

J (u)  =  \  [xl(2)]2  +  %  C  [u(s)]2  ds  . 

This  system  is  equivalent  to  the  second  order  equation  (see  Example 
5  in  [6  ]) 

y(t)  +  y(t-l)  =  u(t). 


where  x^(t)  =  y(t)  and  x^Ct)  *  y(t).  The  optimal  control  is  given 
by  (see  pages  18  and  66  of  [6  ]) 

r 


U/2)  (3  -  t  )  ,  0  s  t  *  1, 


u*(t)  -  < 


6(2  -  t) 


1  «  t  s  2, 


where  6  'fs  -3.1913,  and  the  optimal  cost  is 
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J*  =  J(u*)  ^  15.9574  . 

'-N 

Table  C3.1  illustrates  the  convergence  of  J  to  J*  for  AVE 
and  SPLINE.  It  is  interesting  to  compare  the  CPU  times  (Table  C3.2) 
for  this  two  dimensional  example  with  Table  (Cl. 2)  for  the  scalar 
problem,  Example  Cl.  Note  that  the  total  CPU  time  increased  only  a 

few  seconds.  Tables  (C3.3)  and  (C3.4)  compare  uA  and  ug  to  u* . 

32 

Note  that  ug  is  almost  identical  (to  3  places)  to  u*! 


AVE 

SPLINE 

N 

JN 

|j  -j*| 

N 

dN 

4 

17.3450 

1.3876 

4 

16.0149 

.0575 

8 

16.7215 

.7641 

8 

15.9721 

.0147 

16 

16.3604 

.4030 

16 

15.9618 

.0044 

32 

16.1649 

.2075 

32 

15.9594 

.0020 

J* 

=  15.9574 

J*  = 

15.9574 

TABLE  C3.1 


N_ 

CPU  Sec 

N 

CPU  Sec 
— 

4 

25.5 

28.9 

8 

28.9 

8 

40.8 

16 

34.0 

16 

62.9 

32 

54.4 

32 

105.4 

TABLE  C3.2 


AVE 


time 

-4 

.8 

*  16 

.32 

u 

u 

u 

u 

u* 

■ 

*—  — » 

— 

— 

— 

0.00 

-4.8886 

-4.8486 

-4.8210 

-4.8044 

-4.7872 

0.25 

-4.7369 

-4.7186 

-4.7063 

-4.6982 

-4.6875 

0.50 

-4.4217 

-4.4065 

-4.3988 

-4.3947 

-4.3883 

0.75 

-3 . 9406 

-3.9124 

-3.8976 

-3.8919 

-3.8896 

1.00 

-3.3083 

-3.2590 

-3.2275 

-3.2099 

-3.1915 

1.25 

-2.5562 

-2.4926 

-2.4499 

-2.4239 

-2.3936 

1.50 

-1.72  79 

-1.6711 

-1.6359 

-1.6164 

-1.5957 

1.75 

-  .8670 

-  .8360 

-  .8180 

-  .8082 

-  .7979 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

TABLE  C3.3 


SPLINE 


00  -4.8629 

-4.8047  -4.7918 

-4.7885 

-4.7872 

23  -4.7443 

-4.7024  -4.6908 

-4.6884 

-4.6875 

50  -4.4094 

-4.3940  -4.3906 

-4.3889 

-4.3883  ] 

75  -3.8599 

-3.8852  -3.8880 

-3.8893 

-3.8896  j 

00  -3.1497 

-3.1794  -3.1883 

-3.1906 

-3.1915  ! 

1 

25  -2.3598 

-2.3835  -2.3909 

-2.3930 

-2.3936  j 

i 

50  -1.5463 

-1.5829  -1.5925 

-1.5950 

75  -  .7381 

-  .7834  -  .7942 

-  .7970 

-1.5937  j 
-  .7979 

0.00  0.00 

TABLE  C3.4 


EXAMPLE  C4 


Consider  now  the  three  dimensional  system 


1 

~0  1  0  1 

Xx(t-1) 

0 

A  :  *,<*> 

= 

0  0  1 

x2(t-l) 

+ 

i 

0 

1 

■ 

0  0  oj 

Lx3(t-1L 

i 

i  i 

-lJ 

on  the  interval  0  £  t  <.  3.  We  choose  as  initial  function  the 
constant  vector 

x2(s)  = 

x3(s) 

and  the  cost  is  defined  by 

J(u)  =  (.05)rx1(3)]i  +  ^  \  [u(s)]"  ds  . 

J0 


r  10  ] 

0  ,  -1  s  s  <  0  , 

0  ! 

L  J 

3 


This  is  the  same  problem  as  Example  6  in  the  report  [6  ].  The 
optimal  control  is  found  to  be  (see  page  70  of  [6  ]) 


u*(t) 


6  (1  -  t)2  , 

0  s  t  <  1 

0.0 

1  s  t  s  3 

where  6  j:  -  .4975,  and 


J*  -  4.9751 


A  numerical  summary  for  this  problem  is  presented  in  Table 
(C4. 1) - (C4.4)  and  Figure  (C4.1).  The  total  CPU  time  is  quite 
reasonable,  even  for  this  3  dimensional  system.  Note  that  for 


ll 


SPLINE  it  was  necessary  to  carry  j”  out  to  6  places  in  order  to 

''N 

compute  the  difference  jJ  -J*|. 


AVE 

SPLINE 

N 

-N 

N 

JN 

4 

4.9216 

.0595 

4 

4.9754 

.0003 

8 

4.9504 

.0248 

8 

4.9752 

.0001 

16 

4.9635 

.0116 

16 

4.9752 

.0001 

32 

4.9696 

.0055 

32 

4.9752 

.0001 

J*  = 

4.9751 

J*  = 

4.9751 

TABLE  C4 . 1 


CPU  Sec 
40.8 
51.0 
69.7 
107.1 


SPLINE 

N 

CPU  Sec 

4 

54.4 

8 

81.6 

16 

129.2 

32 

221.0 

TABLE  C4.2 


mmmm 


/ 


/ 
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AVE 


/n4 

u 

^8 

u 

.16 

u 

-.7201 

-.6159 

-.5577 

0.25 

-.4914 

-.3958 

-.3402 

0.50 

-.3153 

-.2326 

-.1830 

0.75 

-.1871 

-.1212 

-.0819 

1.00 

-  .  1002 

-.0537 

-.0281 

1.25 

-.0469 

-.0065 

1.50 

-.0183 

-.0049 

- . 0009 

1.75 

-.0055 

0.00 

2.00 

-.0011 

-.0001 

0.00 

2.25 

-.0001 

0.00 

2.50 

0.00 

0.00 

2.75 

0.00 

0.00 

3.00 

0.00 

0.00 

0.00 

TABLE  C4.3 
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SPLINE 

time 

~8 

-16 

-32 

u*  i 

u 

U 

u 

U 

" 

0.00 

-.4932 

-.4961 

-.4966 

-.4968 

-.4975 

0.25 

-.2767 

-.2791 

-.2793 

-.2794 

-.2798 

0.50 

-.1256 

-.1245 

-.1242 

-.1242 

-.1244 

0.75 

-.0397 

-.0322 

-.0313 

-.0311 

-.0311 

1.00 

-.0052 

-.0016 

-.0005 

-.0002 

0.00 

1.25 

-.0015 

-.0003 

0.00 

0.00 

0.00 

1.50 

- . 0005 

0.00 

0.00 

0.00 

0.00 

1.75 

-.0001 

0.00 

0.00 

0.00 

0.00 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

2.25 

0.00 

0.00 

0.00 

0.00 

0.00 

2.50 

0.00 

0.00 

0.00 

0.00 

0.00 

2.75 

0.00 

0.00 

0.00 

0.00 

0.00 

3.00 

0.00 

0.00 

0.00 

0.00 

0.00 

TABLE  C4.4 


/ 
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EXAMPLE  C5 


This  example  involves  a  two  dimensional  system  with  two 
controls.  The  equation  is  (see  Example  7  in  [  6 ] )  given  by 

r  '1 


U,(t)  I 

L  2  J 


—  ■— i 

r  n 

—  — 

x1(t) 

0  0  ; 

1 

x^(t  -  1) 

1  0 

_d_ 

i 

+ 

dt 

x2(t) 

1  0 

x2(t  -  1) 

0  1 

_ 

J 

_  _ 

—  _ 

where  0  s  t  s  2,  and  the  initial  data  is  defined  by 

n 


x2(s) 


The  cost  function  is  taken  as 


x^s)  ’  1 


lJ 


,  -1  £  S  £  0  . 


J(u)  =  ^{[x1(2)]2  +  [x2(2)]2]  +  ^  ^  {[u1(s)32  +  [u2(s)]M  ds  . 

'0 

The  optimal  control  is  (see  pages  25  and  73  of  [  b])  found  to 


be 


where 


Uj*(t) 


u*(t) 


u£*(t) 


_) 


u1*(t)  =  < 


p.  +  6(1  -  t)  ,  0  s  t  S  1, 

U  >  1  i  t  ?.  2, 


and 


u2*(t)  =  6 


0  ^  t  4  2, 


11 


-0.1880  and  6 


-0.8718 


The  optimal  payoff  has  value 

J*  a:  1.4017  . 

The  results  for  this  problem  are  summarized  in  Tables  (C5 . 1) - (C5 . 5) 
and  Figures  (C5.1)  -  (C5.2). 


TABLE  C5.1 


AVE  -  U;L 


-4 

^8 

-16 

-32 

u! 

U1 

U1 

U1 

U1 

0.00 

-1.0250 

-1.0383 

- 1 . 0489 

-1.0546 

-1.0598 

0.25 

-  .8239 

-  .8261 

-  .8320 

-  .8368 

-  .8418 

0.50 

-  .6342 

-  .6219 

-  .6181 

-  .6195 

-  .6239 

0.75 

-  .4639 

-  .4373 

-  .4188 

-  .4087 

-  .4060 

1.00 

-  .3236 

-  .2919 

-  .2656 

-  .2449 

-  .1880 

1.25 

-  .2248 

-  .2051 

-  .1927 

-  .1872 

-  .1880 

1.50 

-  .1725 

-  .1748 

-  .1797 

-  .1836 

-  .1880 

1.75 

-  .1574 

-  .1712 

-  .1793 

-  .1836 

-  .1880 

2.00 

-  .1564 

-  .1711 

-  .1793 

-  .1836 

-  .1880 

TABLE  C5.2 


AVE 

’  u2 

time 

-4 

U2 

-8 

U2 

-16 

u2 

-32 

u2 

T 

0.00 

-  .8558 

-  .8655 

-  .8695 

-  .8709 

-  .8718 

0.25 

-  .8558 

-  .8655 

-  .8695 

-  .8709 

-  .8718 

0.50 

0.75 

L.00 

1.25 

1.50 

1.75  -  .8558  -  .8655  -  .8695  -  .8709  -  .8718 

2.00  -  .8558  -  .8655  -  .8695  -  .8709  -  .8718 


TABLE  C5.3 
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SPLINE 

‘  U1 

-4 

-16 

-32 

time 

^i 

^1_ 

U1 

U1 

-1.0531 

-1.0641 

-1.0607 

-1.0597 

-1.0598 

0.25 

-  .8340 

-  .8398 

-  .8415 

-  .8411 

-  .8418 

0.50 

-  .5980 

-  .6227 

-  .6226 

-  .6224 

-  .6239 

0.75 

-  .3732 

-  .3931 

-  .4045 

-  .4035 

-  .4060 

1.00 

-  .2202 

-  .2066 

-  .1978 

-  .1945 

-  .1880 

1.25 

-  .1677 

-  .1781 

-  .1832 

-  .1856 

-  .1880 

1.50 

-  .1716 

-  .1800 

-  .1831 

-  .1856 

-  .1880 

1.75 

-  .1698 

-  .1807 

-  .1830 

-  .1856 

-  . 1880  i 

2.00 

-  .1533 

-  .1695 

-  .1776 

-  .1827 

-  .1880 

TABLE 

C5.4 

SPLINE 

-  u2* 

-'8 

-  16 

-32 

time 

U„ 

u. 

u„ 

u„ 

* 

2 

_2 

2 

2 

_2 

— 

0.00 

-.8959 

-.8882 

-.8783 

-.8744 

-.8718 

0.25 

-.9021 

-.8864 

-.8787 

-.8745 

-.87 

18 

0.50 

-.9067 

-.8916 

-.8790 

-.8741 

0.75 

-.9031 

-.8893 

-.8786 

- .8745 

1.00 

-.8956 

-.8875 

-.8782 

-.8744 

1.25 

-.8963 

-.8881 

-.8782 

-.8744 

1.50 

-.9022 

-.8866 

-.8781 

-.8744 

1.75 

-.8810 

-.8904 

-.8776 

-.8744 

-.87 

18 

2.00 

-.7972 

-.8355 

-.8516 

-.8610 

-.8718 

TABLE  C5.5 
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EXAMPLE  C6 

We  consider  a  control  problem  with  system  given  by  the  scalar 
equation 

x(t)  =  x(t)  +  x(t  -  1)  +  u(t),  0  s,  t  s  2, 

and  initial  data 


x(s)  1 


-1  <  s  £  0  . 


The  cost  function  is  defined  by 


J(u)  =  7 


2  Cx(2)]  +  %  ^  Cu(s)]  d 


0 

The  optimal  control  (see  Example  4  on  pages  14  and  63  in  [  6  ])  is 
given  by 


6  [e2~C  +  (1  -  t)e1't]  ,  0  £  t  s  1  , 


u*(t)  = 


a  e 


2-t 


,  1  ^  t  s  2  , 


whe  re  5 


.3932  and 


J*  3.101?  . 


The  numerical  results  for  this  example  are  summarized  in  Tables 
(C6 . 1) - (C6 . 3) .  Observe  again  that  the  SPLINE  scheme  gives  better 
approximations  to  the  payofj  and  control  than  AVE . 
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AVE 

SPLINE 

N 

JN 

N 

f 

4 

3.0084 

.0933 

4 

3.1108 

.0092 

8 

3.0554 

.0462 

8 

3.1047 

.0031 

16 

3.0797 

.0219 

16 

3 . 1030 

.0013 

32 

3.0915 

.0101 

32 

3.1026 

.0009 

J*  = 

3.1017 

J* 

3.1017 

TABLE  C6.1 

AVE 

time 

-4 

.16 

«32 

u* 

u 

u 

u _ 

u _ 

-3.9668 

-3.9702 

-3.9726 

-3.9734 

-3.9742 

0.25 

-2.8512 

-2.8662 

-2.8754 

-2.8807 

-2.8870 

0.50 

-2.0497 

-2.0672 

-2.0759 

-2.0808 

-2.0863 

0.75 

-1.4759 

-1.4917 

-1.4964 

-1.4968 

-1.4986 

1.00 

-1.0684 

-1.0843 

-1.0883 

-1.0868 

-1.0688 

1.25 

-  .7835 

-  .8042 

-  .8154 

-  .8221 

-  .8324 

1.50 

-  .5876 

-  .6136 

-  .6298 

-  .6389 

-  .6483 

1.75 

-  .4517 

-  .4765 

-  .4904 

-  .4975 

-  .5049 

2.00 

-  .3515 

-  .3711 

-  .3819 

-  .3875 

-  .3932 

i 


TABU':  C6.2 


/ 
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-4 

-8 

-16 

-32 

time 

u 

u 

u _ 

u _ 

u* 

0.00 

-3.9717 

-3.9737 

-3.9735 

-3.9733 

-3.9742 

0.25 

-2.8895 

-2.8854 

-2.8870 

-2.8864 

-2.8870 

0.50 

-2.0873 

-2.0894 

-2.0871 

2.0858 

-2.0863 

0.75 

-1.5001 

-1.4968 

-1.4998 

-1.4981 

-1.4986 

1.00 

-1.0949 

-1.0821 

-1.0757 

-1.0728 

-1.0688 

1.25 

-  .8330 

-  .8326 

-  .8326 

-  .8323 

-  .8324 

1.50 

-  .6535 

-  .6488 

-  .6484 

-  .6482 

-  .6483 

1.75 

-  .5012 

-  .5070 

-  .5048 

-  .5048 

-  .5049 

2.00 

-  .3590 

-  .3727 

-  .3819 

-  .3872 

-  .3932 

TABLE  C6.3 
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EXAMPLE  C7 


This  example  is  an  interesting  two  dimensional  problem  for 
which  the  SPLINE  scheme  is  clearly  superior  to  the  AVE  scheme.  It 
is  the  same  as  Example  9  in  [6].  The  equation  is 


X!(t) 

0 

1 

x^t) 

0 

0 

fxju-l) 

1 

ro1 

_d_ 

- 

! 

1 

+ 

dt 

x2(t) 

-1 

0 

x2(t) 

0 

-1 

|x2(t-l) 

1 

L 

_ 

_ 

_  _ 

_ 

_ 

l_  _ 

_ 

where  0  -s  t  ^  2,  and  the  initial  condition  is  given  by 


w 

H 

X 

I _ 

10 

x2(s) 

0 

_  — 

_  — 

-1  £  s  a  0  . 


The  equation  is  the  vector  formulation  of  the  second  order  scalar 
equation 


y(t)  +  y (t  -  1)  +  y(t)  =  u(t)  , 


which  describes  an  harmonic  oscillator  with  delayed  damping.  Tin 
cost  function  is  given  by 


J(u)  =  5  [x^U)]2  +  ^  ^  [u(s)]2  ds 

'  0 


The  optimal  control  (see  pages  11  and  81  in  L  6  J )  is  given  by 

r 


u*(t)  = 


6  sin  (2  -  t)  +  ~(l-t)  sin  (t  -  1)  ,  0  *  L  s  1  , 
6  sin  (2  -  i)  ,  1  f.  t  s  2  , 


t 
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where  6  -  2.5599.  The  optimal  cost  is 

J*  _*  3.3991  . 

This  example  demonstrates  just  how  much  improvement  one  can  obtain 
by  using  the  SPLINE  scheme  in  place  of  AVE. 

In  order  to  check  the  convergence  rates  of  the  two  algorithms, 
we  assume  that 

eN  -  |  jn  -  j*  !  -  k^i/n)5 

and 

?N  =  uN  -  u*  j|L  -  K2(1/N)P  , 

where  K^,  and  g  are  constants-  The  conve rgence  rate ,  g,  can  be 
used  to  compare  the  two  schemes.  For  example,  an  algorithm  with 
p  -  2.0  provides  faster  convergence  than  an  algorithm  with  g  =  1.0. 
Solving  the  above  equations  for  0,  we  find  that 

'  ~  ‘  ^£N/'£2N^  ~ 

0r  2  2 

Consequently,  g  can  be  estimated  Irom  the  numerical  results.  Table 

-N 

C7.1  indicates  the  computed  value  oi  g  for  J  -  J*.  Note  that  g  is 

approximately  one  for  AVE  and  two  for  SPLINE.  The  values  of 
N 

lu  -  u*  used  in  Table*  (’7.4  wort  estimated  by  using  a  simple 
L2 

Euler  scheme  for  the  integration.  Again,  the  convergence  rate  g 


is  approximately  one  for  AVE  and  two  for  SPLINE. 


SPLINE 


N 

l!  i: 

-N 

J  -J* 

4 

2.1515  1 

.2475 

8 

2.6711 

.7280 

16 

3.0035 

.3956 

32 

3.1929 

.2062 

J* 

=  3.3991 

l  |JN-J*I 

3.5354  .1363 


3.4345  .0354 
3.4085  .0094 
3.4019  .0028 

J*  -  3.3991 


TABLE  C7.1 


1 . 0403 

1.1386 

1.1931 

1.2212 

1.4574 

1.6371 

1.7451 

1.8038 

1.7277 

1.9522 

2.0898 

2.1664 

1.8163 

2.0447 

2.1839 

2.2628 

1.7136 

1.9110 

2.0259 

2.0882 

1.4369 

1.5839 

1.6644 

1.7052 

1.0259 

1 . 1209 

1.1727 

1.1997 

.5313 

.5788 

.6052 

.6191 

0.00 

0.00 

0.00 

u* 


1.2506 

1.8645 

2.2467 

2.3501 

2.1541 

1.7449 

1.2273 


TABLE  C7.2 
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SPLINE 


^4 

-8 

-16 

-32 

time 

u 

u 

u _ 

u _ 

u* 

0.00 

1.3669 

1.2786 

1.2579 

1.2527 

1.2506 

0.25 

1.9770 

1.8937 

1.8717 

1.8666 

1.8645 

0.50 

2.3287 

2.2683 

2.2530 

2.2485 

2.2467 

0.75 

2.3805 

2.3611 

2.3527 

2.3511 

2.3501 

1.00 

2.1609 

2.1552 

2.1545 

2.1543 

j 

2.1541 

1.25 

1.7446 

1.7440 

1.7447 

1.7451 

1.7449 

1.50 

1.2018 

1.2210 

1.2258 

1.2271 

1.2273 

1.75 

.5902 

.6232 

.6308 

.6328 

.6333 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

TABLE  C7.3 

AVE 

SPLINE 

N 

!PuN-u*!l, 

3 

N 

l|uN-u*|i 

0 

2 

2 

4 

.5650 

.  .95 

4 

.0954 

1.96 

8 

.2931 

.92 

8 

.0245 

1.95 

16 

.1553 

.97 

16 

.0063 

1.75 

32 

.0795 

... 

32 

.0018 

— 

TABLE  C7.4 


1 
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u*(t) 


((J.-5)et  2  +  [2p,-36-  (p-6) t]eC  1  +  6(t+2)-p,,  Ostsl  , 

e.2 

(u-6)eC  +  6  ,  lsts2, 


where  5  i  -  .2593  and  p  es  5.2262.  The  resulting  optimal  cost  is 


J*  :2  19.7479  . 


aN 

The  convergence  of  J  to  J*  is  summarized  in  Table  (C8 . 1 ')  . 
Again,  the  convergence  rates  (i.e.  ,g)  agree  with  the  expected 

M 

theoretical  values.  The  convergence  of  u  to  u*  is  described  by 

Tables  (C8.2)- (C8.4)  and  plots  of  u^,  u^  and  u*  are  given  in 

A  o 

Figure  (C8.1) 


AVE 

SPLINE 

N 

JN 

■*N 

l j  -j*I 

£ 

N 

JN 

P 

4 

17.9646 

1.7832 

.87 

4 

19.9843 

.2364 

2.39 

8 

18.7745 

.9733 

.95 

8 

19.7929 

.0450 

1.72 

16 

19.2439 

.5039 

.99 

16 

19.7616 

.0137 

1.48 

32 

19.4935 

.2543 

--- 

32 

19.7528 

.0049 

— 

J*  =  19 

.  7479 

J*  = 

19.7479 

TAB Lb  C8.1 


/ 


AVE 

^4 

*16 

*32 

time 

u 

u 

u _ 

u _ 

u* 

0.00 

-.9029 

-.8782 

-.8712 

-.8701 

-.8710 

0.25 

-.3412 

-.2688 

-.2307 

-.2133 

-.1993 

0.50 

.2526 

.3612 

.4276 

.4636 

.4975 

0.75 

.8643 

.9879 

1.0680 

1.1170 

1.1745 

1.00 

1.4926 

1.6054 

1.6739 

1.7132 

1.7587 

1.25 

2.1585 

2.2469 

2.2927 

2.3139 

2.3319 

2.9139 

2.9886 

3.0277 

3.0476 

3.0678 

1.75 

3.8368 

3.9187 

3.9645 

3.9883 

4.0128 

2.00 

5.0122 

5.1115 

5.1673 

5.1962 

5.2262 

TABLE  C8.2 


SPLINE 

time 

*4 

*8 

*16 

*32 

u* 

u 

u 

u _ 

u _ 

0.00 

-.8775 

-.9746 

-.9297 

-.9010 

8710 

0.25 

- . 1303 

-.2995 

-.2441 

-.2231 

-. 

1993 

0.50 

.6421 

.4472 

.4667 

.4785 

4975 

0.75 

1.3224 

1.1445 

1.1595 

1.1662 

1. 

1745 

1.00 

1.9007 

1.7394 

1.7560 

1.7575 

1. 

7587 

1.25 

2.5345 

2.3528 

2.3485 

2.3399 

2. 

3319 

1.50 

3.3597 

3.1217 

3.1068 

3.0871 

3. 

0678 

1.75 

4.2533 

4.1425 

4.0785 

4.0463 

4. 

0128 

2.00 

4.9126 

5.0619 

5 . 1643 

5.1955 

5. 

2262 

TABLE  C8 . 3 


c  > 


AVE 

N 

_ 

||Gn-u»|| 

2 

l 

1  4 

I 

.0944 

1.69 

|  8 

.0293 

1.81 

:  16 

.0083 

1.90 

I 


SPLINE 


_N 

c 

L2 

4 

.0875 

2.52 

8 

.0153 

2.26 

16 

.0032 

1.84 

32 


.0022 


32 


.0009 


I 
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EXAMPLE  C9 


Tli  is  example  is  the  same  as  Example  13  in  [  6  ]  (with 
•,  ■  =  %  2  -  1,  see  page  97  of  [  6  j).  The  system  is  governed  by  tlu 
equation 


it  ■ 

—  — 

r 

-1 

-  -1 

r 

-1 

—  — . 

r- 

— | 

1 F  n 

»'  i 

_d_ 

dt 

x^t) 

= 

'  o 

1 

xL(t) 

t 

0 

0 

x^t-l; 

+ 

j 

l 

0 

!ui(t) 

1 1 

x2(t) 

0 

-1 

x2(t) 

-1 

0 

x2(t-l) 

! 

0 

1 

1  j  u2(t) 

i 

-  _ 

- 

— 

- 

— 

_ 

—  — 

i 

_ 

_ 

!L  J 

with  0  £  t  £  2  and  initial  data 


_  _ 

—  — ■ 

XjCs) 

10 

x2(s) 

0 

_ 

_  _ 

,  -1  S  S  £  0 


The  cost  function  is  given  by 

2 

J  =  MlXj/2)]2  +  Lx2(2)]2}  +  %  ^  {[u]L(s)]2  +  [u2(s')]2}  ds 

0 


Although  the  optimal  control  and  optimal  cost  have  not  been 
computed,  the  numerical  results  given  in  the  following  tables 
are  similar  to  the  previous  examples-  Again  it  appears 


that  SPLINE  provides  improved  convergence  propert ies  over  AVt . 
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AVE 

SPLINE 

N 

f 

N 

JN 

4 

16.2927 

.7615 

4 

18.0819 

.  1814 

8 

17.0542 

.4084 

8 

17.9005 

.0348 

16 

17.4626 

.2014 

16 

17.8657 

.0090 

32 

17.6640 

32 

17.8567 

TABLE  C9.1 


1 - 

AVE  -  u1 

time 

/v4 

.8 

.16 

.32 

U1 

U1 

U1 

0.00 

-2.3842 

-2.5442 

-2.6432 

-2.6920 

0.25 

-1.9485 

-2.0417 

in 

r— < 
rH 

CM 

1 

-2.1601 

0.50 

-1.4369 

-1.4407 

-1.4639 

-1.4947 

0.75 

-  .8927 

-  .7962 

-  .7311 

-  .7000 

1.00 

-  .3798 

-  .2166 

-  .0816 

.0247 

1.25 

.0235 

.  1658 

.2578 

.3042 

1.50 

.2562 

.3092 

.3221 

.322* 

]  .75 

.3284 

.3271 

.3239 

.3224 

2.00 

.  3331 

.3273 

.3239 

.3224 

TABLE  C9.2 
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AVE  -  u2 


! - 

-4 

-8 

-16 

-32 

time 

u 

u 

u 

u _ 

1  0.00 

-.3729 

-.3578 

-.3541 

-.3540 

1 

|  0.25 

.1412 

.1975 

.2273 

.2407 

:  0.50 

.6665 

.7536 

.8068 

.8354 

1 

;  0.75 

1.1900 

1.2891 

1.3527 

1.3912 

;  1.00 

1.7101 

1.7994 

1.8512 

1.8798 

1.25 

2.2453 

2.3141 

2.3453 

2.3573 

1.50 

2.8403 

2.8999 

2.9258 

2 . 9364 

1.75 

3.5615 

3.6321 

3.6650 

3.6788 

2.00 

4.4788 

4.5707 

4.6139 

4.6321 

TABLE  C9.3 

SPLINE  -  ux 

-4 

-8 

-16 

-32 

time 

u 

0 

u _ 

u _ 

0.00 

-2.7993 

-2.7564 

-2.7430 

-2.7366 

0.25 

-2.2589 

-2.2041 

-2.2079 

-2.2025 

0.50 

-1.4849 

-1.5456 

-1.5454 

-1.5400 

0.75 

-  .5920 

-  .6683 

-  .7219 

-  .7100 

1.00 

.0951 

.  1992 

.2532 

.2783 

1.25 

.3615 

.3467 

.3292 

.3256 

1.50 

.3542 

.3351 

.3295 

.3256 

1.75 

.3336 

.3370 

.3294 

.3256 

2.00 

.3040 

.3162 

.3196 

.3206 

TABLE  C9.4 


/ 
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SPLINE  -  u2 


-4 

-8 

-16 

-32 

time 

u 

u 

u _ 

u _ 

0.00 

-.3499 

-.3416 

- .  3488 

-.3520 

0.25 

.3107 

.2604 

.2622 

.2555 

0.50 

.9737 

.9025 

.8753 

.8649 

0.75 

1.5378 

1.4784 

1.4520 

1.4428 

1.00 

1.9986 

1 . 9456 

1.9266 

1.9185 

1.25 

2.4949 

2.4122 

2.3821 

2.3716 

1.50 

3.1407 

2.9946 

2.9646 

2.9528 

1.75 

3.8248 

3.7720 

3.7109 

3.6988 

2.00 

4.2899 

4.4311 

4.5281 

4.5842 

TABLE  C9.5 
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EXAMPLE  CIO 

This  is  a  nonlinear  optimal  control  problem.  Although  the 
basic  idea  has  been  developed  only  for  linear  systems,  much  ol  the 
theory  has  been  extended  to  a  general  class  of  nonlinear  examples 
(.see  [13)-  The  system  is  given  by  the  equation 

x ( t )  ~  x ( t )sin[x( t ) ]  +x(t-l)+u(t),  0  £  t  >2  , 

with  initial  data 


X (s )  £  10  ,  -  1  £  S  £  0  . 


The  cost  I  unction  is 

2  2  2  2 
J  -  h  l x (2) ]  +  h  '  :[x(s)J  +■  Uu(s)j  ]  ds  . 

Jo 

...  n 

Values  of  J  are  given  in  Table  (CiO.l).  This  problem  is  such  that 

.1*  is  relative  "flat".  Consequently,  the  values  of  and  the 
-  N 

controls  ti  changed  very  little  as  N  -.  +  <*  .  Since  the  optimal 

N 

control  u*  is  not  known  analytically  and  u  were  essentially  the 

-  N 

same  for  N  r-  4,  we  did  not  give  tables  for  u  . 


AVE 

SPLINE 

'  N 

.-2N  N, 

-N 

.  ;2N  ,N . 

N 

J 

lJ  ! 

N 

J 

(J  -J  j 

4 

162.020 

.0010 

‘4 

162.113 

.0720 

8 

162.01V 

.0010 

8 

162.041 

.0300 

16 

162.018 

.0030 

16 

162.011 

.0080 

32 

162.015 

32 

167.003 

— 

TABLE  C10.1 
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EXAMPLE  Cll 

This  is  a  nonlinear  example  with  the  same  dynamics  as 
EXAMPLE  CIO,  but  different  initial  condition.  The  system  is 
again  given  by 

x(t)  =  x(t)sin[x(t)]  +  x ( t  -  1)  +  u(t)  ,  0  s  t  -i  2  , 

with  initial  data 

x  (s)  =  Cp(s)  ,  -1  £  s  s  0  , 


where 

y(s)  = 


10(s  +  1)  ,  -1  s  <.  , 

-10s  ,  -%  £  s  £  0  . 


The  cost  functional  is  given  by 

2 

J(u)  =  %[x(s)]2  +  ^  {[x(s>]2  +  [u(s)]2}  ds 

0 


This  nonlinear  problem  is  more  interesting  than  Example  (10. 

Although  the  optimal  control  is  not  known  analytically,  the 

N 

numerical  runs  indicate  that  the  sequence  (u  ]  is  "converging"  to 
an  optimal  control.  If  one  applies  the  maximum  principle  to  the 
nonlinear  control  problem,  there  are  two  boundary  conditions  that 
the  optimal  "state"  and  multiplier  must  satisfy.  Using 


these  boundary  conditions  as  a  check  for  the 


approximating  optimal  control  problem,  we  found  that  the  N  -  16 


SPLINE  procedure  produced  final  values  of  the  "state"  and 

"multipliers"  that  most  nearly  matched  the  boundary  conditions. 

In  view  of  this  fact  and  the  convergence  pattern  illustrated  in 

Tables  C11.1-C11.3,  it  is  reasonable  to  believe  that  the  N  =  16 

SPLINE  run  gives  a  good  estimate  of  the  optimal  control. 

Figure  Cll.l  compares  plots  of  u\  u^  with  u^.  The  plots  of 

S  A  S 

Ug  for  N  =  8,  16  and  32  are  almost  identical. 


|  AVE 

SPLINE 

-N 

.-2N  ,N, 

, -2N  , N , 

i  N 

J 

|J  -J  j 

N 

J 

|J  -.1  |  1 

4 

1.9919 

.  1845 

4 

2 . 5406 

.0179 

1  8 

2.1764 

.  1341 

8 

2.5227 

.0013 

| 

16 

2.3105 

.  0907 

16 

2.5240 

.0010 

32 

2.4012 

— 

32 

2.5230 

TABLE  Cll.l 
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time 

-4 

-8 

-16 

-32 

u 

u 

u _ 

u _ 

0.00 

-2.3013 

-2.3082 

-2.3073 

-2.3033 

0.25 

-2.0915 

-2.1804 

-2.2375 

-2.2706 

0-50 

-1.8241 

-1.9856 

-2.1114 

-2.1972 

0.75 

-1.4673 

-1.5752 

-1.6470 

-1.6906 

1.00 

-1.1190 

-1.1447 

-1.1417 

-1.1317 

1.25 

-  .8349 

-  .8173 

-  .7891 

-  .7697 

1.50 

-  .6208 

-  .5966 

-  .5761 

.5669 

1.75 

-  .4580 

-  .4400 

-  .4321 

-  .4329 

2.00 

-  .3233 

-  .3125 

-  .3098 

-. .3142 

TABLE  C11.2 


time 

,4 

-8 

,16 

,32 

u 

u 

u _ 

u _ 

0.00 

-2.331 

-2.3024 

-2.3017 

-2.2967 

0.25 

-2.3707 

-2.3230 

-2.3156 

-2.3101 

0.50 

-2.2820 

-2.3034 

-2.3106 

-2.3126 

0.75 

-1.6921 

-1.7294 

-1.7404 

-1.7424 

1.00 

-1.0787 

-1.1002 

-1.1041 

-1.1037 

1.25 

-  .7160 

.7427 

-  .7462 

-  .7497 

1.50 

-  .5727 

-  .5644 

-  .5588 

-  .5624 

1.75 

-  .4978 

-  .4591 

-  .4502 

-  .4451 

2.00 

-  .3960 

-  .3496 

-  .3559 

-  .3265 

TABLE  C11.3 


-183- 


Summary  Remarks 

In  examples  C7  and  C8  we  presented  some  estimates  for  the  rates 
N  N 

of  convergence  of  J  -»  J*  and  u  -•  u.  In  these  cases  we  found  that 
the  AVE  scheme  provided  essentially  linear  convergence,  while  SPLINE 
convergence  was  essentially  quadratic.  In  view  of  some  known 
theoretical  facts  these  results  are  not  unexpected.  Specifically, 
in  [  5 ]  it  is  shown  that  for  fixed  control  and  sufficiently  re- 
stricted  initial  data, we  have  z  —  z  is  0(1/N  )  where  8=1  for  AVE 
and  6  =  2  for  SPLINE.  For  the  linear  regulator  problem  (both  OC 
and  OCN)  the  optimal  control  can  be  generated  by  state  feedback. 

If  one  assumes  that  the  feedback  "parameters"  for  OCN  also  converge 

to  the  feedback  "parameters"  for  OC  (see  Delfour  [10])  like  (1/ N"), 

»N  a 

then  it  follows  that  u  -4  u'v  convergence  is  0(1/M  ). 

Additionally,  elementary  calculations  then  reveal  that  one  should 
have  JN  -  J*  is  also  0(1/N^).  For  the  first-order  (piecewise  linear) 
spline  based  method  SPLINE,  the  results  presented  here,  taken  with 
other  numerical  experiments  that  we  have  performed  and  reported  else¬ 
where  (see  r8  [),  are  strong  evidence  that  the  method  SPl.INE 
is  essentially  second  order  (8  =  2)  when  used  with  regulator- type 
optimal  control  problems  involving  linear  delay  systems-  (This  is 
not  too  surprising  when  one  reviews  the  literature  on  finite-element 
methods  and  investigates  such  phenomena  as  super  convergence  tor 
"coercive  problems"  or  "superconvergence  at  nodes".)  The  AVE  scheme, 
on  the  other  hand,  appears  to  be  at  best  only  first  order  (8  =  1) 
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in  these  problems . 

As  a  further  point  of  comparison  we  note  that  SPLINE  yields  a 
better  approximation  for  a  given  value  of  N  in  almost  every  example 
that  we  have  considered  (here  and  elsewhere).  Observe  that  in 
many  of  the  control  examples  (Cl  -  C4,  C6  -  C8)  the  results  for 
SPLINE  at  N  =  4  are  better  than  those  obtained  with  AVE  for  N  =  32. 

While  the  SPLINE  scheme  is  slightly  more  tedious  to  impiiment 
and  takes  a  little  more  computer  time  because  of  the  matrix  systems 
that  must  be  solved  (see  the  Remark  at  the  end  of  J3),  all  the 
evidence  would  seem  to  imply  that  SPLINE  is  a  superior  method  to 
AVE  in  control  problems  of  the  type  we  consider  he  :e . 

For  control  problems  with  nonlinear  systems,  the  numerical 
findings  to  date  are  not  as  dramatic  or  conclusive  (in  part  perhaps 
because  analytic  solutions  are  not  available).  In  addition  to  the 
two  examples  (CIO,  Cll)  reported  here,  numerical  studies  with  other 
nonlinear  systems  tend  to  support  the  conjecture  that  SPLINE  will 
generally  be  as  good  as  or  better  than  AVE  for  nonlinear  problems. 


i 


-185- 


References 

f  1  ]  H.  T.  Banks,  Approximation  of  nonlinear  functional  differential 
equation  control  systems,  J,  Opt.  Theory  Appl . ,  1979,  to  appear. 

(  2  ]  H.  T.  Banks  and  J.  A.  Burns,  An  abstract  framework  for  approxi¬ 
mate  solutions  to  optimal  control  problems  governed  by  heredi¬ 
tary  systems,  in  Proceedings,  Internationa  1  Conference  on 
Differential  Equations,  (Univ.  So.  Calif.,  Sept.,  1974),  li.  A. 
Antosiewicz,  ed..  Academic  Press,  New  York,  1975,  pp.  10-2r'. 

[  3  ]  H.  T.  Banks  and  J.  A.  Burns,  Hereditary  control  problems: 

numerical  methods  based  on  averaging  approximations,  SIAM 
.J.  Control  and  Optimization,  16  (1978),  169-208. 

[  4  ]  H.  T.  Banks  and  J.  A.  Burns,  Approximation  techniques  for 

control  systems  with  delays,  Proc .  Int 1 1  Conference  on  Methods 
of  Mathematical  Programming,  Polish  Scientific  Publishers, 

Warsaw,  1977,  to  appear. 

[  5  ]  H.  T.  Banks,  J.  A.  Burns  and  E.  M.  Cliff,  Parameter  estimation 
and  identification  for  systems  with  delays,  November  1979,  to 
appear . 

|  6  1  H.  T.  Banks,  J.  A.  Burns,  E.  M.  Cliff,  and  P.  R.  Thrift, 

Numerical  solutions  of  hereditary  control  problems  via  an 
approximation  technique.  Brown  University  LCDS  Tech.  Rep. 

75-6,  Providence,  R.T.,  October,  1975. 

[  7  ]  H,  T.  Banks  and  G.  M.  Croome,  Jr.,  Convergence  Theorems  tor 

parameter  estimation  by  quasilinearization,  J.  Math .  Ana  1 .  Appl., 
42  (1973),  91-109.  . * 

[  8  ]  H.  T.  Banks  and  F.  Rappel,  Spline  approximations  for  functional 
differential  equations,  J.  Dif f .  Eq.  ,  to  appear. 

[  9  ]  J.  A.  Burns  and  E.  M.  Cliff,  Parameter  identification  for 

hereditary  systems,  Final  Technical  Report  on  Grant  AKFDL-77- 
3221A,  February,  1979,  AFFDL  Technical  Memorandum,  to  appear. 

| 10]  M.  C.  Delfour,  The  linear  quadratic  optimal  control  problem 
for  hereditary  differential  systems:  theory  and  numerical 
so  1 u t i ons ,  Applied  Math cm at ics  and  Opt .,  3  (1977),  101-162. 

[11]  J.  Hale,  Theory  of  Functional  1)1 f ferential  Equations ,  Sprlnger- 
Verlag,  New  York,  1977. 


